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TECHNICAL FIELD 

This invention relates generally to data storage systems, and more particularly to data 
5 storage systems having redundancy arrangements to protect against total system failure in the 
event of a failure in a component or subassembly of the storage system. 

BACKGROUND 

As is known in the art, large host computers and servers (collectively referred to herein 
as "host computer/servers") require large capacity data storage systems. These large 

1 o computer/servers generally includes data processors, which perform many operations on data 
introduced to the host computer/server through peripherals including the data storage system. 
The results of these operations are output to peripherals, including the storage system. 

One type of data storage system is a magnetic disk storage system. Here a bank of disk 
drives and the host computer/server are coupled together through an interface. The interface 

15 includes "front end" or host computer/server controllers (or directors) and "back-end" or disk 
controllers (or directors). The interface operates the controllers (or directors) in such a way that 
they are transparent to the host computer/server. That is, data is stored in, and retrieved from, 
the bank of disk drives in such a way that the host computer/server merely thinks it is operating 
with its own local disk drive. One such system is described in U.S. Patent 5,206,939, entitled 

20 "System and Method for Disk Mapping and Data Retrieval", inventors Moshe Yanai, Natan 
Vishlitzky, Bruno Alterescu and Daniel Castel, issued April 27, 1993, and assigned to the same 
assignee as the present invention. 

As described in such U.S. Patent, the interface may also include, in addition to the host 
computer/server controllers (or directors) and disk controllers (or directors), addressable cache 

25 memories. The cache memory is a semiconductor memory and is provided to rapidly store data 

from the host computer/server before storage in the disk drives, and, on the other hand, store 

data from the disk drives prior to being sent to the host computer/server. The cache memory 

being a semiconductor memory, as distinguished from a magnetic memory as in the case of the 

disk drives, is much faster than the disk drives in reading and writing data. 
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The host computer/server controllers, disk controllers and cache memory are 
interconnected through a backplane printed circuit board. More particularly, disk controllers are 
mounted on disk controller printed circuit boards. The host computer/server controllers are 
mounted on host computer/server controller printed circuit boards. And, cache memories are 

5 mounted on cache memory printed circuit boards. The disk directors, host computer/server 
directors, and cache memory printed circuit boards plug into the backplane printed circuit board. 
In order to provide data integrity in case of a failure in a director, the backplane printed circuit 
board has a pair of buses. One set the disk directors is connected to one bus and another set of 
the disk directors is connected to the other bus. Likewise, one set the host computer/server 

10 directors is connected to one bus and another set of the host computer/server directors is 

directors connected to the other bus. The cache memories are connected to both buses. Each 
one of the buses provides data, address and control information. 

The arrangement is shown schematically in FIG. 1. Thus, the use of two buses Bl, 
B2 provides a degree of redundancy to protect against a total system failure in the event that 

15 the controllers or disk drives connected to one bus, fail. Further, the use of two buses 
increases the data transfer bandwidth of the system compared to a system having a single 
bus. Thus, in operation, when the host computer/server 12 wishes to store data, the host 
computer 12 issues a write request to one of the front-end directors 14 (i.e., host 
computer/server directors) to perform a write command. One of the front-end directors 14 

20 replies to the request and asks the host computer 12 for the data. After the request has passed 
to the requesting one of the front-end directors 14, the director 14 determines the size of the 
data and reserves space in the cache memory 18 to store the request. The front-end director 
14 then produces control signals on one of the address memory busses Bl, B2 connected to 
such front-end director 14 to enable the transfer to the cache memory 18. The host 

25 computer/server 12 then transfers the data to the front-end director 14. The front-end 

director 14 then advises the host computer/server 12 that the transfer is complete. The front- 
end director 14 looks up in a Table, not shown, stored in the cache memory 18 to determine 
which one of the back-end directors 20 (i.e., disk directors) is to handle this request. The 
Table maps the host computer/server 12 addresses into an address in the bank 14 of disk 

30 drives. The front-end director 14 then puts a notification in a "mail box" (not shown and 
stored in the cache memory 18) for the back-end director 20, which is to handle the request, 
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the amount of the data and the disk address for the data. Other back-end directors 20 poll the 
cache memory 18 when they are idle to check their M mail boxes". If the polled "mail box" 
indicates a transfer is to be made, the back-end director 20 processes the request, addresses 
the disk drive in the bank 22, reads the data from the cache memory 1 8 and writes it into the 

5 addresses of a disk drive in the bank 22. 

When data is to be read from a disk drive in bank 22 to the host computer/server 12 
the system operates in a reciprocal manner. More particularly, during a read operation, a 
read request is instituted by the host computer/server 12 for data at specified memory 
locations (i.e., a requested data block). One of the front-end directors 14 receives the read 

10 request and examines the cache memory 1 8 to determine whether the requested data block is 
stored in the cache memory 18. If the requested data block is in the cache memory 18, the 
requested data block is read from the cache memory 18 and is sent to the host 
computer/server 12. If the front-end director 14 determines that the requested data block is 
not in the cache memory 18 (i.e., a so-called "cache miss") and the director 14 writes a note 

15 in the cache memory 1 8 (i.e., the "mail box") that it needs to receive the requested data 

block. The back-end directors 20 poll the cache memory 1 8 to determine whether there is an 
action to be taken (i.e., a read operation of the requested block of data). The one of the back- 
end directors 20 which poll the cache memory 18 mail box and detects a read operation reads 
the requested data block and initiates storage of such requested data block stored in the cache 

20 memory 1 8. When the storage is completely written into the cache memory 1 8, a read 

complete indication is placed in the "mail box" in the cache memory 18. It is to be noted that 
the front-end directors 14 are polling the cache memory 18 for read complete indications. 
When one of the polling front-end directors 14 detects a read complete indication, such front- 
end director 14 completes the transfer of the requested data which is now stored in the cache 

25 memory 18 to the host computer/server 12. 

The use of mailboxes and polling requires time to transfer data between the host 
computer/server 12 and the bank 22 of disk drives thus reducing the operating bandwidth of 
the interface. 
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SUMMARY OF THE INVENTION 

In accordance with the invention, a method is provided for determining Cyclic 
Redundancy Check (CRC) parity of data, such data comprising a plurality of bytes, each one 
of the bytes having a parity bit, the plurality of bytes of data having a CRC. The method 
5 includes generating the parity of the parity bits of the plurality of bytes of the data, such 
generated parity being the parity of the CRC of such data. 

In accordance with another feature of the invention, a method is provided for 
performing a check of the parity bit of a Cyclic Redundancy Cycle (CRC) of data, such data 
comprising a plurality of bytes, each byte having a parity bit. The method includes: 
10 generating parity of the parity bits of the plurality of data bytes; and comparing such 
generated parity with the parity bit of the CRC of the data. 

In accordance with still another feature of the invention, a method is provided for 
determining Cyclic Redundancy Check (CRC) parity of data, such data having a parity bit, 
the data having a CRC. The method includes comparing the parity of the data with the parity 
bit of the CRC of the data. 

In one embodiment, a method^eon^jrises: receiving data having a plurality of N bytes: 
[D(0), D(l), . . . ,D(N-1]) ^aelTbyte having a parity bit p; and computing the parity of [P(0), 
P(1),...P(N-1)J. 

The details of one or more embodiments of the invention are set forth in the accompa- 
20 nying drawings and the description below. Other features, objects, and advantages of the 
invention will be apparent from the description and drawings, and from the claims. 




DESCRIPTION OF DRAWINGS 

These and other features of the invention will become more readily apparent from the 
following detailed description when read together with the accompanying drawings, in 
25 which: 

FIG. 1 is a block diagram of a data storage system according to the PRIOR ART; 
FIG. 2 is a block diagram of a data storage system according to the invention; 
FIG. 2 A shows the fields of a descriptor used in the system interface of the data 
storage system of FIG. 2; 
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FIG. 2B shows the filed used in a MAC packet used in the system interface of the 
data storage system of FIG. 2; 

FIG. 3 is a sketch of an electrical cabinet storing a system interface used in the data 

storage system of FIG. 2; 

FIG. 4 is a diagramatical, isometric sketch showing printed circuit boards providing 
the system interface of the data storage system of FIG. 2; 

FIG. 5 is a block diagram of the system interface used in the data storage system of 

FIG. 2; 

FIG. 6 is - a block diagiam showing thg^pormootions between fronted and - ba i k -c n d 
10 directors to one of a p^rjifjaessage^ietwork boards used in the system interface of the data 
sterggg syatom of FIG. 2? 

FIG. 7 is a block diagram of an exemplary one of the director boards used in the 
system interface of he data storage system of FIG. 2; 

FIG. 8 is a block diagram of the system interface used in the data storage system of 

15 FIG. 2; 

FIG. 8 A is a diagram of an exemplary global cache memory board used in the system 
interface of FIG. 8; 

FIG. 8B is a diagram showing a pair of director boards coupled between a pair of host 
processors and global cache memory boards used in the system interface of FIG. 8; 

■ FIG. 9 is a more delar ted-bk H* diagram nf the exemplary rarhe memory hre tfd^f- 
FIG. 8A; 

FIG. 10 is a block diagram of a crossbar switch used in the memory board of FIG. 9; 
FIG. 1 1 is a block diagram of an upper port interface^s€ction used in the crossbar 
switch of FIG. 1 0; 

25 FIG. 1 2 is a block diagram of alpwerport interface section used in the crossbar 

switch of FIG. 10; 

FIG. 13 is a bJoeiTdlagram of a pair of logic sections used in the memory board of 

FIG. 9; 

JFKS. 14 is a block diagram of a pair of port controllers used in the pair of logic 
30 sections of FIG. 13; 
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FIG. 15 is a block diagram of a pair of arbitration logics used in the pair oHpglc 
sections of FIG. 13 and of a watchdog section used for such pair of logic sections; 

FIG. 16 is a diagram showing words that make up exemplarWpfbnnation cycle used 
in the memory board of FIG. 9; 
5 FIG. 17 is a Truth Table for a majority gate use>inthe memory board of FIG. 9; 

FIG. 18 is a block diagram shown interconnections between one of the arbitration 
units used in one of the pair of port controllers of FIG. 13 and a filter used in the arbitration 
unit of the other one of such pak^fcontrollers of FIG. 13; 

FIG. 19 is a timing^iagram of signals in arbitration units of FIG. 18 used of one of 
1 o the pair of port conptfrfers of FIG. 1 4 and a filter used in the arbitration unit used in the other 
one of such paifof controllers of FIG. 14; and 

PIG. 20 is a more detailed block diagram of arbitrations used in the arbritration logics 
- qfflG. 15L* 

DETAILED DESCRIPTION 

15 Referring now to FIG. 2, a data storage system 100 is shown for transferring data 

between a host computer/server 120 and a bank of disk drives 140 through a system interface 
160. The system interface 160 includes: a plurality of, here 32 front-end directors I8O1-I8O32 
coupled to the host computer/server 120 via ports-123 32 ; a plurality of back-end directors 
2OO1-2OO32 coupled to the bank of disk drives 140 via ports 123 3 3-12364; a data transfer 

20 section 240, having a global cache memory 220, coupled to the plurality of front-end 

directors 180i-180i 6 and the back-end directors 200i-200i 6 ; and a messaging network 260, 
operative independently of the data transfer section 240, coupled to the plurality of front-end 
directors I8O1-I8O32 and the plurality of back-end directors 200i-200 32 , as shown . The front- 
end and back-end directors I8O1-I8O32, 200i-200 32 are functionally similar and include a 

25 microprocessor (uP) 299 (i.e., a central processing unit (CPU) and RAM), a message engine/ 
CPU controller 314 and a data pipe 3 16 to be described in detail in connection with FIGS. 5, 
6 and 7. Suffice it to say here, however, that the front-end and back-end directors I8O1-I8O32, 
200i-200 32 control data transfer between the host computer/server 120 and the bank of disk 
drives 140 in response to messages passing between the directors I8O1-I8O32, 2OO1-2OO32 

30 through the messaging network 260. The messages facilitate the data transfer between host 
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computer/server 120 and the bank of disk drives 140 with such data passing through the global 
cache memory 220 via the data transfer section 240. More particularly, in the case of the 
front-end directors 180i-180 32 , the data passes between the host computer to the global cache 
memory 220 through the data pipe 316 in the front-end directors 180i-180 32 and the 

5 messages pass through the message engine/CPU controller 3 14 in such front-end directors 
180i-180 32 . In the case of the back-end directors 200i-200 3 2 the data passes between the 
back-end directors 200i-200 32 and the bank of disk drives 140 and the global cache memory 
220 through the data pipe 316 in the back-end directors 200i-200 32 and again the messages 
pass through the message engine/CPU controller 314 in such back-end director 200j-200 32 . 

1 0 With such an arrangement, the cache memory 220 in the data transfer section 240 is not 

burdened with the task of transferring the director messaging. Rather the messaging network 
260 operates independent of the data transfer section 240 thereby increasing the operating 
bandwidth of the system interface 160. 

In operation, and considering first a read request by the host computer/server 120 

15 (i.e., the host computer/server 120 requests data from the bank of disk drives 140), the 

request is passed from one of a plurality of, here 32, host computer processors 121 1-121 32 in 
the host computer 120 to one or more of the pair of the front-end directors I8O1-I8O32 
connected to such host computer processor 121 1-121 32 . (It is noted that in the host computer 
120, each one of the host computer processors 121 1 -121 32 is coupled to here a pair (but not 

20 limited to a pair) of the front-end directors 180i-180 32 , to provide redundancy in the event of 
a failure in one of the front end-directors 181 1-I8I32 coupled thereto. Likewise, the bank of 
disk drives 140 has a plurality of, here 32, disk drives 141 1-141 32 , each disk drive 141 1-141 32 
being coupled to here a pair (but not limited to a pair) of the back-end directors 200i-200 32> to 
provide redundancy in the event of a failure in one of the back-end directors 200i-200 32 

25 coupled thereto). Each front-end director 1 8O1-1 80 32 includes a microprocessor (uP) 299 
(i.e., a central processing unit (CPU) and RAM) and will be described in detail in connection 
with FIGS. 5 and 7. Suffice it to say here, however, that the microprocessor 299 makes a 
request for the data from the global cache memory 220. The global cache memory 220 has a 
resident cache management table, not shown. Every director I8O1-I8O32, 200i-200 3 2 has 

30 access to the resident cache management table and every time a front-end director 1 8O1-1 80 32 
requests a data transfer, the front-end director 180i-180 32 must query the global cache 
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memory 220 to determine whether the requested data is in the global cache memory 220. If 
the requested data is in the global cache memory 220 (i.e., a read "hit"), the front-end director 
180i-18032,more particularly the microprocessor 299 therein, mediates a DMA (Direct 
Memory Access) operation for the global cache memory 220 and the requested data is 

5 transferred to the requesting host computer processor 1 2 1 1 - 1 2 1 32 . 

If, on the other hand, the front-end director I8O1-I8O32 receiving the data request 
determines that the requested data is not in the global cache memory 220 (i.e., a "miss") as a 
result of a query of the cache management table in the global cache memory 220, such front- 
end director 180i-180 32 concludes that the requested data is in the bank of disk drives 140. 

10 Thus the front-end director 1 8O1-1 80 32 that received the request for the data must make a 

request for the data from one of the back-end directors 200i-200 32 in order for such back-end 
director 2OO1-2OO32 to request the data from the bank of disk drives 140. The mapping of 
which back-end directors 200i-200 3 2 control which disk drives 141 1-HI32 in the bank of disk 
drives 140 is determined during a power-up initialization phase. The map is stored in the 

15 global cache memory 220. Thus, when the front-end director I8O1-I8O32 makes a request for 
data from the global cache memory 220 and determines that the requested data is not in the 
global cache memory 220 (i.e., a "miss"), the front-end director I8O1-I8O32 is also advised by 
the map in the global cache memory 220 of the back-end director 200i-200 3 2 responsible for 
the requested data in the bank of disk drives 140. The requesting front-end director 1 80i- 

20 1 8O32 then must make a request for the data in the bank of disk drives 140 from the map 
designated back-end director 200r200 32 . This request between the front-end director I8O1- 
I8O32 and the appropriate one of the back-end directors 200i-200 32 (as determined by the map 
stored in the global cache memory 200) is by a message which passes from the front-end 
director 180i-180 32 through the message network 260 to the appropriate back-end director 

25 2OO1-2OO32. It is noted then that the message does not pass through the global cache memory 
220 (i.e., does not pass through the data transfer section 240) but rather passes through the 
separate, independent message network 260. Thus, communication between the directors 
I8O1-I8O32, 2OO1-2OO32 is through the message network 260 and not through the global cache 
memory 220. Consequently, valuable bandwidth for the global cache memory 220 is not 

30 used for messaging among the directors I8O1-I8O32, 2OO1-2OO32. 
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Thus, on a global cache memory 220 "read miss", the front-end director I8O1-I8O32 
sends a message to the appropriate one of the back-end directors 2OO1-2OO32 through the 
message network 260 to instruct such back-end director 200i-200 32 to transfer the requested 
data from the bank of disk drives 140 to the global cache memory 220. When accomplished, 

5 the back-end director 200i-200 32 advises the requesting front-end director I8O1-I8O32 that the 
transfer is accomplished by a message, which passes from the back-end director 2OO1-2OO32 
to the front-end director 180i-180 32 through the message network 260. In response to the 
acknowledgement signal, the front-end director I8O1-I8O32 is thereby advised that such front- 
end director 180i-180 32 can transfer the data from the global cache memory 220 to the 

10 requesting host computer processor 121 1-121 32 as described above when there is a cache 
"read hit". 

It should be noted that there might be one or more back-end directors 2OO1-2OO32 
responsible for the requested data. Thus, if only one back-end director 200i-200 3 2 is 
responsible for the requested data, the requesting front-end director 180i-180 32 sends a uni- 

15 cast message via the message network 260 to only that specific one of the back-end directors 
200i-200 32 . On the other hand, if more than one of the back-end directors 200i-200 32 is 
responsible for the requested data, a multi-cast message (here implemented as a series of uni- 
cast messages) is sent by the requesting one of the front-end directors 180i-180 32 to all of the 
back-end directors 200i-200 32 having responsibility for the requested data. In any event, 

20 with both a uni-cast or multi-cast message, such message is passed through the message 
network 260 and not through the data transfer section 240 (i.e., not through the global cache 
memory 220). 

Likewise, it should be noted that while one of the host computer processors 121 1- 
121 32 might request data, the acknowledgement signal may be sent to the requesting host 
25 computer processor 121 1 or one or more other host computer processors 121 1-121 32 via a 
multi-cast (i.e., sequence of uni-cast) messages through the message network 260 to 
complete the data read operation. 

Considering a write operation, the host computer 120 wishes to write data into storage 
(i.e., into the bank of disk drives 140). One of the front-end directors I8O1-I8O32 receives the 
30 data from the host computer 120 and writes it into the global cache memory 220. The front- 
end director I8O1-I8O32 then requests the transfer of such data after some period of time 
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when the back-end director 200i-200 32 determines that the data can be removed from such 
cache memory 220 and stored in the bank of disk drives 140. Before the transfer to the bank 
of disk drives 140, the data in the cache memory 220 is tagged with a bit as "fresh data" (i.e., 
data which has not been transferred to the bank of disk drives 140, that is data which is "write 
pending"). Thus, if there are multiple write requests for the same memory location in the 
global cache memory 220 (e.g., a particular bank account) before being transferred to the 
bank of disk drives 140, the data is overwritten in the cache memory 220 with the most 
recent data. Each time data is transferred to the global cache memory 220, the front-end 
director 180i-180 32 controlling the transfer also informs the host computer 120 that the 
transfer is complete to thereby free-up the host computer 120 for other data transfers. 

When it is time to transfer the data in the global cache memory 220 to the bank of 
disk drives 140, as determined by the back-end director 200i-200 32 , the back-end director 
200i-200 32 transfers the data from the global cache memory 220 to the bank of disk drives 
140 and resets the tag associated with data in the global cache memory 220 (i.e., un-tags the 
data) to indicate that the data in the global cache memory 220 has been transferred to the 
bank of disk drives 140. It is noted that the un-tagged data in the global cache memory 220 
remains there until overwritten with new data. 

Referring now to FIGS. 3 and 4, the system interface 160 is shown to include an 
electrical cabinet 300 having stored therein: a plurality of, here eight front-end director 
boards 190i-190 8 , each one having here four of the front-end directors I8O1-I8O32; a plurality 
of, here eight back-end director boards 210i-210 8 , each one having here four of the back-end 
directors 200i-200 32 ; and a plurality of, here eight, memory boards 220' which together make 
up the global cache memory 220. These boards plug into the front side of a backplane 302. 
(It is noted that the backplane 302 is a mid-plane printed circuit board). Plugged into the 
backside of the backplane 302 are message network boards 304,, 304 2 . The backside of the 
backplane 302 has plugged into it adapter boards, not shown in FIGS. 2-4, which couple the 
boards plugged into the back-side of the backplane 302 with the computer 120 and the bank 
of disk drives 140 as shown in FIG. 2. That is, referring again briefly to FIG. 2, an I/O 
adapter, not shown, is coupled between each one of the front-end directors I8O1-I8O32 and the 
host computer 120 and an I/O adapter, not shown, is coupled between each one of the back- 
end directors 200i-200 32 and the bank of disk drives 140. 
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Referring now to FIG. 5, the system interface 160 is shown to include the director 
boards 190i.l90 8 , 210i-210 8 and the global cache memory 220, plugged into the backplane 
302 and the disk drives 141 1-141 32 in the bank of disk drives along with the host computer 
120 also plugged into the backplane 302 via I/O adapter boards, not shown. The message 

5 network 260 (FIG. 2) includes the message network boards 304i and 304 2 . Each one of the 
message network boards 304i and 304 2 is identical in construction. A pair of message 
network boards 304i and 304 2 is used for redundancy and for message load balancing. Thus, 
each message network board 304i, 304 2 , includes a controller 306, (i.e., an initialization and 
diagnostic processor comprising a CPU, system controller interface and memory, as shown in 

10 FIG. 6 for one of the message network boards 304i, 304 2> here board 304i) and a crossbar 
switch section 308 (e.g., a switching fabric made up of here four switches 3O81-3O84). 

Referring again to FIG. 5, each one of the director boards 190i-210 8 includes, as 
noted above four of the directors I8O1-I8O32, 200 r 200 32 (FIG. 2). It is noted that the director 
boards 190i-190 8 having four front-end directors per board, I8O1.I8O32 are referred to as 

15 front-end directors, and the director boards 210i-210 8 having four back-end directors per 
board, 200i-200 32 are referred to as back-end directors. Each one of the directors 1 8O1-1 80 32 , 
200i-200 32 includes a CPU 310, a RAM 312 (which make up the microprocessor 299 
referred to above), the message engine/CPU controller 314, and the data pipe 316. 

Each one of the director boards 190i-210 8 includes a crossbar switch 318. The 

20 crossbar switch 3 1 8 has four input/output ports 319, each one being coupled to the data pipe 
316 of a corresponding one of the four directors 180i-180 32 , 200i-200 32 on the director 
board.l90i-210 8 . The crossbar switch 31 8 has eight output/input ports collectively identified 
in FIG. 5 by numerical designation 321 (which plug into the backplane 302. The crossbar 
switch 318 on the front-end director boards 191 1-191 8 is used for coupling the data pipe 316 

25 of a selected one of the four front-end directors I8O1-I8O32 on the front-end director board 
190 t -190 8 to the global cache memory 220 via the backplane 302 and I/O adapter, not shown. 
The crossbar switch 318 on the back-end director boards 210i-210 8 is used for coupling the 
data pipe 316 of a selected one of the four back-end directors 200 r 200 32 on the back-end 
director board 210i-210 8 to the global cache memory 220 via the backplane 302 and I/O 

30 adapter, not shown. Thus, referring to FIG. 2, the data pipe 3 1 6 in the front-end directors 
I8O1-I8O32 couples data between the host computer 120 and the global cache memory 220 
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while the data pipe 316 in the back-end directors 200i-200 32 couples data between the bank 
of disk drives 140 and the global cache memory 220. It is noted that there are separate point- 
to-point data paths Pi-P^ (FIG. 2) between each one of the directors I8O1-I8O32, 200i-200 32 
and the global cache memory 220. It is also noted that the backplane 302 is a passive 
backplane because it is made up of only etched conductors on one or more layers of a printed 
circuit board. That is, the backplane 302 does not have any active components. 

Referring again to FIG. 5, each one of the director boards 190i-210 8 includes a 
crossbar switch 320. Each crossbar switch 320 has four input/output ports 323, each one of 
the four input/output ports 323 being coupled to the message engine/CPU controller 3 14 of a 
corresponding one of the four directors I8O1-I8O32, 200i-200 32 on the director board 190 r 
210 8 . Each crossbar switch 320 has a pair of output/input ports 325i, 325 2 , which plug into 
the backplane 302. Each port 325 r 325 2 is coupled to a corresponding one of the message 
network boards 304i, 304 2 , respectively, through the backplane 302. The crossbar switch 
320 on the front-end director boards 190i-190 8 is used to couple the messages between the 
message engine/CPU controller 314 of a selected one of the four front-end directors I8O1- 
1 80 32 on the front-end director boards 190i-190 8 and the message network 260, FIG. 2. 
Likewise, the back-end director boards 210i-210 8 are used to couple the messages produced 
by a selected one of the four back-end directors 200 r 200 32 on the back-end director board 
210i-210 8 between the message engine/CPU controller 314 of a selected one of such four 
back-end directors and the message network 260 (FIG. 2). Thus, referring also to FIG. 2, 
instead of having a separate dedicated message path between each one of the directors I8O1- 
1 80 32 , 200i-200 32 and the message network 260 (which would require M individual 
connections to the backplane 302 for each of the directors, where M is an integer), here only 
M/4 individual connections are required). Thus, the total number of connections between the 
directors 1 80 r l 80 32 , 200i-200 32 and the backplane 302 is reduced to l/4th. Thus, it should be 
noted from FIGS. 2 and 5 that the message network 260 (FIG. 2) includes the crossbar switch 
320 and the message network boards 304i, 304 2 . 

Each message is a 64-byte descriptor, shown in FIG. 2A, which is created by the CPU 
310 (FIG. 5) under software control and is stored in a send queue in RAM 312. When the 
message is to be read from the send queue in RAM 312 and transmitted through the message 
network 260 (FIG. 2) to one or more other directors via a DMA operation to be described, it 
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is packetized in the packetizer portion of packetizer/de-packetizer 428 (FIG. 7) into a MAC 
type packet, shown in FIG. 2B, here using the NGIO protocol specification. There are three 
types of packets: a message packet section; an acknowledgement packet; and a message 
network fabric management packet, the latter being used to establish the message network 

5 routing during initialization (i.e., during power-up). Each one of the MAC packets has: an 8- 
byte header which includes source (i.e., transmitting director) and destination (i.e., receiving 
director) address; a payload; and terminates with a 4-byte Cyclic Redundancy Check (CRC), 
as shown in FIG. 2B. The acknowledgement packet (i.e., signal) has a 4-byte 
acknowledgment payload section. The message packet has a 32-byte payload section. The 

10 Fabric Management Packet (FMP) has a 256-byte payload section. The MAC packet is sent 
to the crossbar switch 320. The destination portion of the packet is used to indicate the 
destination for the message and is decoded by the switch 320 to determine which port the 
message is to be routed. The decoding process uses a decoder table 327 in the switch 3 1 8, 
such table being initialized by controller during power-up by the initialization and diagnostic 

15 processor (controller) 306 (FIG. 5). The table 327 (FIG. 7) provides the relationship between 
the destination address portion of the MAC packet, which identifies the routing for the 
message and the one of the four directors 180i-180 32 , 200 r 200 3 2 on the director board 190i- 
190 8 , 210i-210 8 or to one of the message network boards 304j, 304 2 to which the message is 
to be directed. 

20 More particularly, and referring to FIG. 5, a pair of output/input ports 325i, 3252 is 

provided for each one of the crossbar switches 320, each one being coupled to a 
corresponding one of the pair of message network boards 304i, 304 2 . Thus, each one of the 
message network boards 304i, 304 2 has sixteen input/output ports 322i-322i 6 , each one being 
coupled to a corresponding one of the output/input ports 325 1, 325 2 , respectively, of a 

25 corresponding one of the director boards 190i-190 8 , 210i-210 8 through the backplane 302, as 
shown. Thus, considering exemplary message network board 304i, FIG. 6, each switch 308 r 
308 4 also includes three coupling ports 324i- 324 3 . The coupling ports 324 r 324 3 are used 
to interconnect the switches 322i-322 4 , as shown in FIG. 6. Thus, considering message 
network board 304j, input/output ports 322i-322 8 are coupled to output/input ports 325i of 

30 front-end director boards 1 90i-l 90 8 and input/output ports 322 9 -322i 6 are coupled to 
output/input ports 325 1 of back-end director boards 210i-210 8 , as shown. Likewise, 
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considering message network board 304 2 , input/output ports 322i-322 8 thereof are coupled, 
via the backplane 302, to output/input ports 325 2 of front-end director boards 190i-190 8 and 
input/output ports 322 9 -322i 6 are coupled, via the backplane 302, to output/input ports 325 2 
of back-end director boards 210i-210g. 

5 As noted above, each one of the message network boards 304i, 304 2 includes a 

processor 306 (FIG. 5) and a crossbar switch section 308 having four switches 308i-308 4 , as 
shown in FIGS. 5 and 6. The switches 308i-308 4 are interconnected as shown so that 
messages can pass between any pair of the input/output ports 322i -322i 6 . Thus, it follow 
that a message from any one of the front-end directors 180i-180 32 can be coupled to another 

10 one of the front-end directors 180i-180 32 and/or to any one of the back-end directors 200i- 
2OO32. Likewise, a message from any one of the back-end directors 1 8O1-I8O32 can be 
coupled to another one of the back-end directors I8O1.I8O32 and/or to any one of the front- 
end directors 2OO1-2OO32. 

As noted above, each MAC packet (FIG. 2B) includes in an address destination 

1 5 portion and a data payload portion. The MAC header is used to indicate the destination for 
the MAC packet and such MAC header is decoded by the switch to determine which port the 
MAC packet is to be routed. The decoding process uses a table in the switch 308i-308 4 , such 
table being initialized by processor 306 during power-up. The table provides the relationship 
between the MAC header, which identifies the destination for the MAC packet and the route 

20 to be taken through the message network. Thus, after initialization, the switches 320 and the 
switches 308i-308 4 in switch section 308 provides packet routing which enables each one of 
the directors 180i-180 32 , 200i-200 32 to transmit a message between itself and any other one 
of the directors, regardless of whether such other director is on the same director board 190i- 
190 8 , 210i-210 8 or on a different director board. Further, the MAC packet has an additional 

25 bit B in the header thereof, as shown in FIG. 2B, which enables the message to pass through 
message network board 304i or through message network board 304 2 . During normal 
operation, this additional bit B is toggled between a logic 1 and a logic 0 so that one message 
passes through one of the redundant message network boards 304i, 304 2 and the next 
message to pass through the other one of the message network boards 304i, 3042 to balance 

30 the load requirement on the system. However, in the event of a failure in one of the message 
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network boards 304i, 304 2 , the non-failed one of the boards 304,, 304 2 is used exclusively 
until the failed message network board is replaced. 

Referring now to FIG. 7, an exemplary one of the director boardsl90i-190 8 , 210i- 
210g, here director board 190i is shown to include directors 180i, I8O3, 18O5 and I8O7. An 

5 exemplary one of the directors 1 80 1 - 1 80 4 , here director 1 80 1 is shown in detail to include the 
data pipe 316, the message engine/CPU controller 314, the RAM 312, and the CPU 310 all 
coupled to the CPU interface bus 317, as shown. The exemplary director I8O1 also includes: 
a local cache memory 319 (which is coupled to the CPU 310); the crossbar switch 318; and, 
the crossbar switch 320, described briefly above in connection with FIGS. 5 and 6. The data 

1 0 pipe 3 1 6 includes a protocol translator 400, a quad port RAM 402 and a quad port RAM 
controller 404 arranged as shown. Briefly, the protocol translator 400 converts between the 
protocol of the host computer 120, in the case of a front-end director 180i-180 32 , (and 
between the protocol used by the disk drives in bank 140 in the case of a back-end director 
2OO1-2OO32) and the protocol between the directors I8O1-I8O3, 200i-200 32 and the global 

1 5 memory 220 (FIG. 2). More particularly, the protocol used the host computer 1 20 may, for 
example, be fibre channel, SCSI, ESCON or FICON, for example, as determined by the 
manufacture of the host computer 120 while the protocol used internal to the system interface 
160 (FIG. 2) may be selected by the manufacturer of the interface 160. The quad port RAM 
402 is a FIFO controlled by controller 404 because the rate data coming into the RAM 402 

20 may be different from the rate data leaving the RAM 402. The RAM 402 has four ports, 
each adapted to handle an 18 bit digital word. Here, the protocol translator 400 produces 36 
bit digital words for the system interface 160 (FIG. 2) protocol, one 18 bit portion of the 
word is coupled to one of a pair of the ports of the quad port RAM 402 and the other 18 bit 
portion of the word is coupled to the other one of the pair of the ports of the quad port RAM 

25 402. The quad port RAM has a pair of ports 402 A, 402B, each one of to ports 402 A, 402B 
being adapted to handle an 18 bit digital word. Each one of the ports 402 A, 402B is 
independently controllable and has independent, but arbitrated, access to the memory array 
within the RAM 402. Data is transferred between the ports 402A, 402B and the cache 
memory 220 (FIG. 2) through the crossbar switch 3 18, as shown. 

30 The crossbar switch 3 1 8 includes a pair of switches 406A, 406B. Each one of the 

switches 406 A, 406B includes four input/output director-side ports D1-D4 (collectively 
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referred to above in connection with FIG. 5 as port 319) and four input/output memory-side 
ports M1-M4, M 5 -M 8 , respectively, as indicated. The input/output memory-side ports M1-M4, 
M 5 -M 8 were collectively referred to above in connection with FIG. 5 as port 317). The 
director-side ports D1-D4 of switch 406A are connected to the 402A ports of the quad port 
RAMs 402 in each one the directors I8O1, 180 3 , 18O5 and I8O7, as indicated. Likewise, 
director-side ports of switch 406B are connected to the 402B ports of the quad port RAMs 
402 in each one the directors I8O1, 180 3 , 18O5, and 180 7) as indicated. The ports D1-D4 are 
selectively coupled to the ports M1-M4 in accordance with control words provided to the 
switch 406A by the controllers in directors I8O1, 180 3 , 18O5, 18O7 on busses Rai-Ra4, 
respectively, and the ports D1-D4 are coupled to ports M 5 -M 8 in accordance with the control 
words provided to switch 406B by the controllers in directors I8O1, 18O3, 180 5 , 18O7 on 
busses Rbi-Rb4, as indicated. The signals on buses R A i-Ra4 are request signals. Thus, port 
402A of any one of the directors I8O1, 18O3, 18O5, 180 7 may be coupled to any one of the 
ports M1-M4 of switch 406A, selectively in accordance with the request signals on buses R A i- 
R A4 . Likewise, port 402B of any one of the directors I8O1-I8O4 may be coupled to any one 
of the ports M 5 -M 8 of switch 406B, selectively in accordance with the request signals on 
buses R B i-Rb4- The coupling between the director boards 190,-190 8 , 210i-210 8 and the 
global cache memory 220 is shown in FIG. 8. 

More particularly, and referring also to FIG. 2, as noted above, each one of the host 
computer processors 121 1 -121 32 in the host computer 120 is coupled to a pair of the front- 
end directors 180i-180 32> to provide redundancy in the event of a failure in one of the front 
end-directors 181 1-I8I32 coupled thereto. Likewise, the bank of disk drives 140 has a 
plurality of, here 32, disk drives 141 1-141 32 , each disk drive 141 1-141 32 being coupled to a 
pair of the back-end directors 200i-200 32( to provide redundancy in the event of a failure in 
one of the back-end directors 200i-200 32 coupled thereto). Thus, considering exemplary host 
computer processorl21 1, such processor 121 1 is coupled to a pair of front-end directors I8O1, 
180 2 . Thus, if director I8O1 fails, the host computer processor 121 1 can still access the 
system interface 160, albeit by the other front-end director 180 2 . Thus, directors I8O1 and 
180 2 are considered redundancy pairs of directors. Likewise, other redundancy pairs of 
front-end directors are: front-end directors I8O3, 180 4 ; 180 5 , 180 6; I8O7, 180 8; 180 9) 180i 0 ; 
180,,, 180,25 180,3, 180,4; 180, 5> 180, 6; 180, 7 , 180, 8; 180, 9 , 180 20 ; I8O21, 180 22; 180 23 , 180 24; 
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180 25 , 180 26 ; 180 27 , 180 28 ; 180 29 , 180 30 ; and I8O31. 180 32 (only directors I8O31 and 180 32 being 
shown in FIG. 2). 

Likewise, disk drive 141 1 is coupled to a pair of back-end directors 200 1, 200 2 . Thus, 
if director 200i fails, the disk drive 141 1 can still access the system interfacel60, albeit by the 

5 other back-end director 1 80 2 . Thus, directors 200i and 200 2 are considered redundancy pairs 
of directors. Likewise, other redundancy pairs of back-end directors are: back-end directors 
2OO3, 200 4 ; 200 5 , 200 6 ;200 7 ,2008; 200 9 ,200 10 ;200 1 i, 200i 2 ; 200i 3 , 200i 4 ;200, 5 , 200i 6; 200 n , 
200i8; 2OO19, 200 20 ; 20021, 200 22; 200^, 200 24; 200 25 , 200 26 ; 200 27 , 200 28 ; 200 29 , 200 30 ; and 
200 3 i, 200 32 (only directors 200 3 i and 200 32 being shown in FIG. 2). Further, referring also to 

1 0 FIG. 8, the global cache memory 220 includes a plurality of, here eight, cache memory 
boards 220i-220 8 , as shown. Still further, referring to FIG. 8A, an exemplary one of the 
cache memory boards, here board 220i is shown in detail and will be described in detail in 
connection with FIGS. 23-29. Here, each cache memory board includes four memory array 
regions, an exemplary one thereof being shown and described in connection with FIG. 6 of 

15 U.S. Patent No. 5,943,287 entitled "Fault Tolerant Memory System", John K. Walton, 

inventor, issued August 24, 1999 and assigned to the same assignee as the present invention, 
the entire subject matter therein being incorporated herein by reference. Further detail of the 
exemplary one of the cache memory boards. 

As shown in FIG. 8A, the board 220i includes a plurality of, here four RAM memory 

20 arrays, each one of the arrays has a pair of redundant ports, i.e., an A port and a B port. The 
board itself has sixteen ports; a set of eight A ports Mai-Mas and a set of eight B ports M B r 
M B8 . Four of the eight A port, here A ports M A i-M A 4 are coupled to the Mi port of each of 
the front-end director boards 190 h 190 3 , 190 5 , and 190 7 , respectively, as indicated in FIG. 8. 
Four of the eight B port, here B ports M B i-M B 4 are coupled to the Mi port of each of the 

25 front-end director boards 1 90 2 , 1 90 4 , 1 90 6 , and 1 90 8 , respectively, as indicated in FIG. 8. 
The other four of the eight A port, here A ports Mas-Mas are coupled to the Mi port of each 
of the back-end director boards 210i, 2 1 0 3 , 210 5 , and 210 7 , respectively, as indicated in FIG. 
8. The other four of the eight B port, here B ports M B s-M48 are coupled to the Mi port of 
each of the back-end director boards 210 2 , 210 4 , 210 6 , and 210 8 , respectively, as indicated in 

30 FIG. 8 
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Considering the exemplary four A ports M A i-M A 4, each one of the four A ports M A i- 
M A 4 can be coupled to the A port of any one of the memory arrays through the logic network 
221 ia, to be described in more detail in connection with FIGS. 25, 126 and 27. Thus, 
considering port M A i, such port can be coupled to the A port of the four memory arrays. 

5 Likewise, considering the four A ports M A s-M A8 , each one of the four A ports M A5 -M A8 can 
be coupled to the A port of any one of the memory arrays through the logic network 221 i B . 
Likewise, considering the four B ports M B i-Mb4, each one of the four B ports M B i-M B 4 can 
be coupled to the B port of any one of the memory arrays through logic network 221 ib. 
Likewise, considering the four B ports M B5 -M B8 , each one of the four B ports M B5 -M B8 can 

1 o be coupled to the B port of any one of the memory arrays through the logic network 22 1 2B . 
Thus, considering port M B i, such port can be coupled to the B port of the four memory 
arrays. Thus, there are two paths data and control from either a front-end director I8O1-I8O32 
or a back-end director 200i-200 32 can reach each one of the four memory arrays on the 
memory board. Thus, there are eight sets of redundant ports on a memory board, i.e., ports 

15 Mai, M B i; Ma2, M b2 ; Mas, M b3 ; M a4 , M^; Mas, M B5 ; M A6 , M b6 ; M A7 , M B7 ; and M A8 , M B8 . 
Further, as noted above each one of the directors has a pair of redundant ports, i.e. a 402A 
port and a 402 B port (FIG. 7). Thus, for each pair of redundant directors, the A port (i.e., 
port 402 A) of one of the directors in the pair is connected to one of the pair of redundant 
memory ports and the B port (i.e., 402B) of the other one of the directors in such pair is 

20 connected to the other one of the pair of redundant memory ports. 

More particularly, referring to FIG. 8B, an exemplary pair of redundant directors is 
shown, here, for example, front-end director I8O1 and front end-director 180 2 . It is first 
noted that the directors 1 8O1, 1 80 2 in each redundant pair of directors must be on different 
director boards, here boards 190 ( , 190 2 , respectively. Thus, here front-end director boards 

25 1 90i- 1 90 8 have thereon: front-end directors 1 8O1, 1 8O3, 1 80 5 and 1 80 7 ; front-end directors 
180 2 , 18O4, 180 6 and 180 8 ; front end directors I8O9, 180n, I8O13 and 180i 5 ; front end 
directors I8O10, 180 12 , 180i 4 and 180 i6 ; front-end directors I8O17, 18O19, 18O21 and 180 23 ; 
front-end directors 180i 8 , 180 20 , 180 22 and 180 24 ; front-end directors 180 25) 180 27 , 180 29 and 
I8O31; front-end directors 180i 8 , 180 20 , 180 22 and 180 24 . Thus, here back-end director boards 

30 2 1 0i -2 1 0 8 have thereon: back-end directors 200i, 200 3 , 200 5 and 200 7 ; back-end directors 
200 2> 2OO4, 200 6 and 200 8 ; back-end directors 200 9) 200 n , 200i 3 and 200 )5 ; back-end 
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directors 200i 0 , 200i 2 , 200i 4 and 200i 6 ; back-end directors 200n, 200i 9 , 200 2 i and 200 23 ; 
back-end directors 200i 8> 200 20 , 200 22 and 200 24 ; back-end directors 200 25 , 200 27 , 200 29 and 
2OO31; back-end directors 200i 8> 200 20 , 200 22 and 200 24 . 

Thus, here front-end director I8O1, shown in FIG. 8 A, is on front-end director board 
190i and its redundant front-end director 180 2 , shown in FIG. 8B, is on anther front-end 
director board, here for example, front-end director board 190 2 . As described above, the port 
402A of the quad port RAM 402 (i.e., the A port referred to above) is connected to switch 
406A of crossbar switch 318 and the port 402B of the quad port RAM 402 (i.e., the B port 
referred to above) is connected to switch 406B of crossbar switch 318. Likewise, for 
redundant director 180 2> However, the ports M1-M4 of switch 406A of director I8O1 are 
connected to the M A i ports of global cache memory boards 220i-200 4 , as shown, while for its 
redundancy director 180 2 , the ports M r M 4 of switch 406A are connected to the redundant 
M B i ports of global cache memory boards 220i-200 4 , as shown. 

Further details are provided in co-pending patent application Serial No 09/561 ,53 1 
filed April 28, 2000 and 09/561,161 assigned to the same assignee as the present patent 
application, the entire subject matter thereof being incorporated herein by reference. 



CACHE MEMORY BOARDS 

•ftefegmg-a gain to FIG , 8, t he syste m in c lud e s a plurality of, hero eight, m emegy- 
boards. As described above in connection with FIG. 8A, each one^fjrie-m^mory boards 
includes four memory array regions Ri-R^ RefemnsJiew^oFIG. 9, an exemplary one of 
the cache memory boards in the cachemenlorySo (FIG. 8), here cache memory board 220 u 
is shown in more detail>4flc1ud^rhere, the four logic networks 221 i B , 221 2B , 221 i A , and 
221 2A and^^ere-^Ight interface, or memory region control, sections, here logic sections 
♦50 4 - 61 ^ 50108, arr an g e d as a hown ^ 

Each one of the four logic networks 221 m, 221 2B , 221 i A , and 221 2A includes four sets 
of serial-to-parallel converters (S/P), each one of the sets having four of the S/P converters. 
The sets of S/P converters are coupled between ports M B i-M B 4, M B5 -M B8 , M A i-M A4 , and 
M A5 -M A5 , respectively, and a corresponding one of four crossbar switches 5004i-5004 4 . The 
S/Ps convert between a serial stream of information (i.e., data, address, and control, Cyclic 
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Redundancy Checks (CRCs), signaling semaphores, etc.) at ports M B i-M B 8, M A i-M A 8, and a 
parallel stream of the information which passes through the crossbar switches 5004i-5004 4 . 
Thus, here the crossbar switches 5004i-5004 4 process parallel information. Information is 
transferred between directors and the crossbar switches as transfers, or information cycles. 

5 An exemplary information transfer for information passing for storage in the memory array 
region is shown in FIG. 16. Each information cycle is shown to include a plurality of sixteen 
bit words, each word being associated with a clock pulse. Thus, first word 0 is shown to 
include protocol signaling (e.g., semaphore) and a terminating "start-frame" indication. The 
next word 1 includes memory control information. The next three words, 2-4, include 

10 memory address (ADDR) information. The next word, 5, is a "tag" which indicated the 
memory board, memory array region, and other information to be described. The next two 
words, 6 and 7, provide Cyclic Redundancy Checks (CRC) information regarding the address 
(ADDR_CRC). The DATA to be written into the memory then follows. The number of 
words of DATA is variable and here is between 4 words and 256 words. The information 

15 cycle terminates with two words, X and Y which include DATA CRC information. 

As will be described in more detail below, the cache memory board 220i is a multi- 
ported design which allows equal access to one of several, here four, regions of memory (i.e., 
here memory array regions R1-R4) from any of here sixteen ports M B i-M B 8, Mai-Mas- The 
sixteen ports M B i-M B8 , Mai -Mas are grouped into four sets S1-S4. Each one of the sets S1-S4 

20 is associated with, i.e., coupled to, a corresponding one of the four crossbar switches 5004 r 
5004 4 , respectively, as indicated. Each one of the crossbar switches 5004i-5004 4 
interconnects its upper four ports 5006i-5006 4 to a corresponding one of the four memory 
regions Ri-R» in a point-to-point fashion. Thus, between the four crossbar switches 5004i- 
5004 4 and the four memory regions Ri-R) there are sixteen potential unique interconnects. 

25 The communication between any port M B i -M B8 , Mai-Mas and its corresponding 

crossbar switch 5004i-5004 4 is protected by Cyclic Redundancy Check (CRC) defined by 
CCITT-V.41 . The communication between a crossbar switch 5004i-5004 4 and the memory 
array region Ri-Rt is protected by byte parity (p). There is a pipelined architecture from the 
port M B i-M B8 , Mai-M A 8. Such architecture includes a pipeline having the crossbar switches 

30 5004i-5004 4 , the logic sections 501 0i-501 0 8 and, the memory array regions R1-R4. 
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Each one of the memory regions R1-R4 is here comprised of SDRAM memory chips, 
as noted above. Each one of these regions R1-R4 is coupled to the four crossbar switches 
5004i-5004 4 through a pair of memory region controller, herein referred to as logic sections, 
here logic sections 5010i, 5010 2 ; ... 5010 7 , 5010 8 , respectively. Each logic section 5010 r 
5010 8 is dual ported, (i.e., Port_ A, (A) and Port_ B, (B)) with each port being coupled to one 
of the crossbar switches. The two logic sections 5010i, 5010 2 ; ... 5010 7 , 5010 8 (i.e., region 
controllers) associated with one of the memory regions R1-R4, respectively, share control of 
the SDRAM in such memory region. More particularly, and as will be described in more 
detail below, each pair of logic section, such as for example pair 501 0i and 5010 2 , share a 
common DATA port of memory array region Ri. However, each one of the logic sections 
5010i and 5010 2 is coupled to a different control port P A and P B , respectively, of memory 
array region Ri, as indicated. 

More-partkttteriyreaeh on e of the cro s sbar switches 1004(^1^64^3 , he re/fUur 
lower ports 5008 r 50 08 4 and four upper ports 5006i-5006 4 . Each one of the fou^jjpper ports 
5006i-5006 4 , is, as noted above, coupled to a corresponding one of the four^efs S1-S4, 
respectively, of four of the S/P converters. As noted above, the cache memory board 220\ 
also includes eight logic sections coupled 5010i - 5010 8 (to be described in detail in 
connection with FIG. 13) as well as the four memory array regions R1-R4.. An exemplary 
one of the memory array regions R1-R4 is described in copfiection with FIG. 6 of U. S. Patent 
No. 5,943,287. As described in such U. S. Patent, eaptfone of the memory array regions 
includes a pair of redundant control ports P A , PB / afid a data/chip select port (here designated 
as DATA). As described in such U. S. Patoat; data may be written into, or read from, one of 
the memory array regions by control sigffals fed to either port P A orto port P B . In either case, 
the data fed to, or read from, the memory array region is on the common DATA port. 

An exemplary one of tife logic sections 5010] - 5010 8 will be discussed below in 
detail in connection with^lGS. 13-15 and an exemplary one of the crossbar switches 5004j- 
5004 4 in the logic networks 221 i B -221 2A will be discussed below in detail in connection with 
FIGS. 10-12. Sjaffice it to say here, however, each one of the memory array regions R1-R4 is 
coupled to a^airof the logic sections 5010i, 5010 2 ; 5010 3 , 5010 4 ; 5010 5 , 5010 6 ; 5010 7 , 
50 10 8 , respectively, as shown. More particularly, each one of the logic sections 5010i, 
5010^50103, 5OIO4 SOlOs, 5010 6 ; 5010 7 , 5010 8 includes: a pair of upper ports, Port_A (A), 
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Port_B (B); a control port, C; and a data port, D, as indicated. The control port C of oneeaclT 
one of the logic sections 5010i, 5010 3 , 5010 5 , 5010 7 , is coupled to port P A of a corresponding 
one of the four memory array regions R1-R4. In like manner, the controLpeffC of one of 
each one of the logic sections 5010 2 , 5010 4 , 5010 6 , 5010gjspjupled to port P B of a 

5 corresponding one of the four memory array rejgiorrs^T^, respectively as shown. Thus, 
each one of the memory array regiojjs-^R^ is coupled to a redundant pair of the logic 
sections 5010i, 501 O^J^Q^SQX 0 4 ; 5010 5 , 5010 6 ; 5010 7 , 5010 8 , respectively. The data ports 
D of logic secjieripairs 5010i, 5010 2 ; 5010 3 , 5010 4 ; 5010 5 , 5010 6 ; 5010 7 , 5010 8 , respectively, 
are coupled together and to the DATA port of a corresponding one of the memory regions, 

10 R^R4, icapoctivcly, as indicated,. 

It should be noted that each one of the crossbar switches 5004i-5004 4 is adapted to 
couple the upper ports 5006i-5006 4 thereof to the lower ports 5008i-5008 4 thereof selectively 
in accordance with a portion (i.e., a "tag" portion) of the information fed to the crossbar 
switch. In response to such "tag" portion, a transfer of information between a selected one of 

15 the memory array regions Ri-R/j and a selected the of the directors coupled to the crossbar 
switch is enabled. The memory control portion (e.g., read, write, row address select, column 
address select, etc.) of the information passes between either port A or port B of a logic 
sections 5010i, 5010 3 , 5010 5 , 5010 7 , and port P A of the memory array region coupled 
to such logic section and the data (DATA) portion of the information passes to the DATA 

20 port of such coupled memory array region R1-R4, respectively. Likewise, the control portion 
of the information passes between port A or port B of a logic sections 50102, 5010 4 , 50106, 
5010 8 , and port P B of the memory array region R1-R4 coupled to such logic section and the 
data portion of the information passes to the DATA port of such coupled memory array 
region R1-R4, respectively. 

25 Thus, each one of the logic sections 5010i-5010 8 includes a pair of redundant upper 

ports, A and B. The lower ports 5008i-5008 4 of crossbar switch 5004] are coupled to the A 
port of logic sections 5010i, 5010 3> 50 1 0 5 , and 5010 7 , respectively, while the lower ports 
5008i-5008 4 of crossbar switch 5004 2 are coupled to the B port of logic sections 5010i, 
5010 3 , 50105, and 5010 7 , respectively. The lower ports 5008 r 5008 4 of crossbar switch 5004 3 

30 are coupled to the A port of logic sections 5010i, 5010 3> 50 1 0 5 , and 5010 7 , respectively, while 
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the lower ports 5008i-50 08 4 of crossbar switch 5004 4 are coupled to the B port of logic 
sections 5010 2 , 5010 4 , 50 1 0 6 , and 5010 8 , respectively. 

As-noted-abeve-in^QaHec tion wi t h FIG. 2, each one of the hust compute r proce ssor^ 
121 1 -121 32 is coupled to here a pair (but not limited to a pair) of the front-end directors V80i- 
18032, to provide redundancy in the event of a failure in one of the front end-directors/81 1- 
I8I32 coupled thereto. Likewise, the bank of disk drives 140 has a plurality of, her/32, disk 
drives 141 1-141 32 , each disk drive 141 1-141 32 is coupled to here a pair (but noUimited to a 
pair) of the back-end directors 200i-200 3 2, to provide redundancy in the everft of a failure in 
one of the back-end directors 200i-200 3 2 coupled thereto. Thus, the system has redundant 
front-end processor pairs 121 u 121 2 through 121 3 i, 121 32 and redundant back-end processor 
pairs 141 1, 141 2 through 141 3 i, 141 32 . Considering the exemplary logic network 220i shown 
in FIG. 9, as noted above in connection with FIG. 8B, redupdant front-end processor pairs 
121 1 and 121 2 , are able to be coupled to ports M A i and Mbi of a cache memory board. Thus, 
the ports M A i and M B i may be considered as redundant memory board ports. In like manner, 
the following may be considered as redundant memory ports because the are able to be 
coupled to a pair of redundant processors: Mfo and M B 2; Ma3 and M B 3; M A 4 and M B4 ; M A 5 
and M B5 ; M A6 and M B6 ; M A7 and M B7 ; and; M A8 and M B8 . It is noted that ports M M and M B i; 
Ma2 and M B2 ; and M B3 ; M A4 m&MB4 are coupled to the front-end processors through 
front-end directors and ports Mydnd M B5 ; M A6 and M B6 ; M A7 and M B7 ; M A8 and M B8 are 
coupled to the disk drives through back-end directors. 

Referring again to,FlG. 9, from the above it should be noted then that logic networks 
22 1 ib and 22 1 i A may beconsidered as a pair of redundant logic networks (i.e., pair 1) 
because they are able to be coupled to redundant pairs of processors, here front-end 
processors. Likewise, logic networks 221 2B and 221 2 Amay be considered as a pair of 
redundant logic networks (i.e., pair 2) because they are able to be coupled to redundant pairs 
of disk drives. Further, logic network 22 1 i B of pair 1 is coupled to upper port A of logic 
sections/5010i, 5010 3 , 5010 5 , and 5010 7 while logic network 221 i A of pair 1 is coupled to 
port //of the logic sections 5010 2 , 5010 4 , 5010 6 , and 5010 8 . Logic network 221 2B of pair 2 is 
counfled to port B of logic sections 5010i, 5010 3 , 5010 5 , and 5010 7 while logic network 221 2A 
(fcfta ii 2 is co upled to port B - of t he lo g ic sectie m 50102, 5 0 10 4 , 5 61 0 6 , arid 50iQ»g»» 
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Thus, from the above it is noted that ports M B i-M B 4, which are coupled to one of a 
pair of redundant processors, are adapted to be coupled to one of the ports in a pair of 
redundant control ports, here port P A of the four memory array regions R1-R4 while ports 
M A i-M A 4, of the other one of the pair of redundant processors are adapted to be coupled to 

5 the other one of the ports of the redundant control ports, here port P B of the four memory 
array regions R1-R4. Likewise, ports M B5 -M B8 , which are coupled to one of a pair of 
redundant processors, are adapted to be coupled to one of the ports in a pair of redundant 
control ports, here port P A of the four memory array regions R1-R4 while ports M A 5-M A8 , of 
the other one of the pair of redundant processors are adapted to be coupled to the other one of 

1 0 the ports of the redundant control ports, here port P B of the four memory array regions Ri -R4. 
qfr tB, the meiiiuiy beard 220| (FIG Q)4raiiaiiged with d -p a i r of indopcndcnH a^ 
domains: One fault domain, Fault Domain A, is associated with logic networks 221 i^and 
221 2B , logic sections 5010i, 50 1 0 3 5010 5 , 5010 7 , and ports P A of the memory array/fegions 
R1-R4 and, the other fault domain, Fault Domain B, is associated with logic networks 221 i A 

15 and 221 2A , logic sections 5010 2 , 5010 4 , 5010 6 , 5010 8 and port P B of the mernory array 

regions R1-R4. The logic in each one of the fault domains is operated/by a corresponding one 
of a pair of independent clocks, Clock 1 and Clock 2 (FIG. 9). More generally, a fault 
domain is defined as a collection of devices which share one^r more common points of 
failure. Here, Fault Domain A includes: logic networks^ 1 i B , 221 2B (i e., the S/Ps and 

20 crossbar switches 5004i-5004 2 therein) and logic sections 5010i, 5010 3 , 5010 5 , 5010 7 , such 
devices being indicated by lines which slope from lower left to upper right (i.e., III). The 
other fault domain, Fault Domain B, indudes: logic networks 221 i A , 221/uj (i.e., the S/Ps and 
crossbar switches 5004 3 -5004 4 therein) and logic sections 5010 2 , 5010 4 , 5010 6 , 5010 8 , such 
devices being indicated by line^which slope from upper left to lower right (i. e., WW). It is 

25 noted from FIG. 9 that portfC of each one of the memory array regions Ri -R4 is coupled to 
Fault Domain A white'port P B is coupled to fault domain B. Thus, each one of the fault 
domains includeyme devices used to couple one of a pair of redundant processors to one of a 
pair of redundant control ports P A , P B of the memory array regions R1-R4 and the other fault 
domain includes the devices used to couple the other one of the pair of redundant processors 

30 to Wother one of a pair of redundant control ports P A , P B of the memory array regions Ri- 
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R4. As noted above each fault domain operates with a clock (i.e., clock 1, clock 2) sera 
from and independent of the clock used to operate the other fault domain. 

Referring now to FIG. 10, an exemplary one of the crossbar switche^5d04 r 50044 J 
here crossbar switch 5004i is shown in detail to include four upper pcjrrinterface sections A- 
5 D and lower port interface sections W-Z. The details of anejserfiplary one of the upper port 
interface sections A-D, here upper port interface secJiefiA, will be described in more detail 
in connection with FIG. 1 1 and the detailspf-affexemplary one of the lower port interface 
sections W-Z, here lower port interface section W, will be described in more detail in 
connection with ¥lG^JJ2^fhe function of the exemplary crossbar switch 5004i is to mediate 
10 the infonn^kJiicycle at the request of an initiating one of the directors coupled to one of the 
upper^006i-5006 4 and one logic section 5010 r 5010 8 indicated by the "tag" portion of the 
Jom iation (FIG. 16V 

More particularly, the crossbar switches request, negotiate, and then effect a transfer 
between the upper thereof 5006i-5006 4 and the lower ports 5008i-50 08 4 thereof in a manner 
15 to be described below. Suffice it to say here, however, that the upper interface section A-D 
handle the protocol between the director requesting a information cycle and the memory 
board 220 1 (FIG. 8). It also provides a control and data interface to the serial-to-parallel (S- 
P) converters (e.g., serializer-deserializer). These interface sections A-D are also responsible 
for generating parity across the address, control, DATA, and CRC received from the director. 
There are here two parity bits, one per cycle as described in co-pending patent application 
entitled "Fault Tolerant Parity Generation" filed May 20, 1999, Serial No. 99/315,437, and 
assigned to the same assignee as the present invention, the entire subject matter being 
incorporated herein by reference. As described in such patent application, the parity is 
generated such that one byte has odd parity and the other byte has even parity. The sense of 
25 ^these parity bits alternate on successive clocks. 

■ The lowoi ^orti nterface sections W- Z pro\ 4de9-addicss, l oyOx o }^ 
to one of the four of the logic sections 5010i-5010 8 (FIGJ^ttfr^^ to be described. 
Each one of the lower interface sections W^is^d^ted to couple a corresponding one of the 
four memory array vQgionsR^r^G. 9) 9 respectively, via logic sections 5010i-5010 8 . 
30 Each oneotlhe^ourlo^ interface sections W-Z independently acts as an arbiter between 
lour upper interface sections A-D and the logic section 5010i-5010 8 coupled thereto. 
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This allows for simultaneous transfers (i.e., information^^s) to multiple memory array 
regions R1-R4 from multiple upperjiiterfacrsections A-D. The upper interface section A-D 
are single threadecM^oS^ cycle must be complete before another information 

al lowed to - the s amo memory array regions - Rp R * - 
5 The lower interfaces W-Z deliver control, address and the "tag" field (to be described 

in more detail below) to the logic section 5010i-5010 8 . The parity across these fields are 
generated in the upper interface sections A-D and then pass unmodified such that the 
memory array region can check for alternating parity sense. For write transfers, the lower 
interface sections W-Z also deliver the write data to the memory array region, checking for 
10 correct CRC across the data. If any error is detected, and if the control field indicates a 
"Wait-and-Validate" process to be described, the parity of the last double byte of data is 
corrupted (e.g., a fault is induced in the parity (p) thereof) such that the logic section 5010r 
5010 8 coupled thereto detects the corrupted parity and inhibits execution of the information 
cycle. Otherwise, the alternating parity of the data is unmodified. For read transfers, the 
15 lower interface sections W-Z accept the data from the memory array regions R1-R4 via the 
logic sections 5010i-5010 8 , check the alternating parity, and generates CRC to be returned to 
the director. 

More- pai ' liculai ' ly, as s tt m e for example that information aUu ppui puil 5 0p6'4 (FIG. 9 ) * 
of crossbar switch 5004 4 is to be transferred to memory array region Ri Referring to FIG. 10 
a negotiation, i.e., arbitration, must be made by lower port interf^ce^W as a result of a request 
made by the upper port interface section D of crosgbarSwitch 5004 4 to section interface W 
thereof. When interface section^Us^mlable to satisfy such request, (i.e., not satisfying 
request fromjrtheTonT^ lie upper port interface sections A-C) interface W issues a grant to 
>r interface section -ftr 

25 Thus, each one of the upper port sections A-D sends requests signals (REQs) to the 

lower port sections W-Z when such upper port sections A-D wants access to (i.e., wants to be 
coupled to) such lower port sections. Conversely, each one of the upper port sections A-D 
receives grant signals (GR) from the lower port sections W-Z when such lower port sections 
W-Z grants access to (i.e., wants to be coupled to) such upper port sections A-D. The request 

30 (REQ) and grant (GR) signals, produced by and received from the upper port sections A-D 
and lower port sections W-Z are as follows: 
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where: 

For upper port section A: 
5 RWA is a request signal sent by upper port section A to lower port section W; 

RXA is a request signal sent by upper port section A to lower port section X; 

RYA is a request signal sent by upper port section A to lower port section Y; 

RZA is a request signal sent by upper port section A to lower port section Z; 

GWA is a grant signal from lower port section W to upper port section A; 
10 GXA is a grant signal from lower port section X to upper port section A; 

GYA is a grant signal from lower port section Y to upper port section A; 
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GZA is a grant signal from lower port section Z to upper port section A; 
For upper port B: 

RWB is a request signal sent by upper port section B to lower port section W; 

RXB is a request signal sent by upper port section B to lower port section X; 
5 RYB is a request signal sent by upper port section B to upper port section Y; 

RZB is a request signal sent by upper port section B to lower port section Z; 

GWB is a grant signal from lower port section W to upper port section B; 

GXB is a grant signal from lower port section X to upper port section B; 

GYB is a grant signal from lower port section Y to upper port section B; 
10 GZB is a grant signal from lower port section Z to upper port section B; 

and so forth for the remaining upper and lower port sections C-D and W-Z. 



Each one of the upper port sections A-D has four ports A1-A4, through D1-D4, 
respectively, as shown. Each one of the lower port sections W-Z has four ports W1-W4, 
15 through Zi-Z 4j respectively, as shown. Ports Ai -A4 are connected to ports W1-Z1, 
respectively, as shown. In like manner, Ports Bi -B 4 are connected to ports W2-Z2, 
respectively, as shown, ports Ci -C4 are connected to ports W3-Z3, as shown, and Ports Di - 
D 4 are connected to ports W4-Z4, as shown. Lower ports 5008i-5008 4 are connected to lower 
port sections W-Z. respectively, as shown. 

• As not e d above, an exemplary one of4ho upper port intcrfaoc - s o ct t ons A - D and a^ - 
exemplary one of the lower port interface sections W-Z will be described in morecjetail in 
connection with FIGS. 1 1 and 12, respectively. Suffice it to say here, howeye<that 
information fed to port 5006i is coupled to ports 5008i-5008 4 selectjydyin accordance with 
a "tag 11 portion such information. In a reciprocal manner, injarfnation fed to port 5008 1 is 
25 coupled to ports 5006i-5006 4 selectively in accordajie6with the "tag" portion in such 
information. Further, ports 5006 2 -5006 4 opsrgtein like manner to port 5006i, so that 
information at such ports 5OO62^006Tmay be coupled to ports 5008i-5008 4 . Still further, 
ports 50082-50084 openjje-inlike manner to port 5008 1, so that information at such ports 
50082-50 084 may^becoupled to ports 5006i-5006 4 . It should also be noted that information 
30 may app^afsimultaneously at ports 5008 1 - 5OO84 with the information at one of such ports 
beirfgcoupled simultaneously to one of the ports 5006i-5006 4 while information at another 
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one of the ports 5008i - 5008 4 is coupled to a different one of the ports 5006i-5^064? It is 
also noted that, in a reciprocal manner, information may appear simultaneously at ports 
5006i - 5006 4 with the information at one of such ports being couple^imultaneously to one 
of the ports 5008i-5008 4 and with information at another onepftne ports 5006i - 5006 4 being 
5 coupled to a different one of the ports 5008i-5008 4 ^-^ 

Referring now to FIG. 1 1, an exempjffl^one of the upper port interface sections A-D, 
here upper port interface section A^-^hown in more detail. It is first noted that the 
information at port 5006j>w5ludes: the "tag" portion referred to above; an address CRC 
ADDR_CRC pojtktfCan address ADDR portion, a memory control portion (i.e., read/write, 
10 trarefei>rtgtC"Wait and Validate", etc.); a data portion, (DATA); and a DATA Cyclic 
ft^nda a c y Che c k (CRC) portion (DATA_CRC)^ 

The "tag" portion includes: a two bit word indicating the one of the four memory 
array regions R1-R4 where the data is to be stored/read; a three bit word indicating the one of 
the eight memory boards having the desired array region R1-R4; a four bit word indicating the 
15 one of the 16 director boards 190i-190 8 , 210i-210 8 (FIG. 8) having the director which 

initiated the transfer; a two bit word indicating which one of the four directors on such one of 
the director boards is making the requested data transfer; and a five bit random number 
designating, (i.e., uniquely identifying) the particular information cycle. 

The information described above passing from the director to the crossbar switch 
20 (i.e., the "tag", the ADDR_CRC, the ADDR, the memory control, the DATA, and the 

DATA_CRC) for the entire information cycle (FIG. 1 7) are successively stored in a register 
5100, in response to clock pulses Clock 1, in the order described above in connection with 
FIG. 17. The information stored in the register 5100 is passed to a parity generator (PG) 
5102 for appending to such information a byte parity (p). After passing through the parity 
25 generator (PG) 5102, the different portions of the information are stored in registers 5104 r 
5104 6 , as follows: Register 5104, stores the DATA_CRC portion (with the generated parity); 
register 5104 2 , here a FIFO, stores the data portion, DATA, (with the generated parity); 
register 5104 3 stores the memory control portion (with the generated parity); register 5104 4 
stores the address ADDR portion (with the generated parity), register 5104 5 stores the address 
30 ADDR_CRC portion (with the generated parity); and register 5 1 04 6 stores the "tag" portion 
(with the generated parity) in the order shown in FIG. 17. Each clock pulse (Clock 1 or 
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Clock 2) results in one of the words described above in connection with FIG. 17. Here, each 
word has two bytes and is stored in register 5100. The word stored in register 5100 is then 
shifted out of register 5100 with the next clock pulse, as new information becomes stored in 
such register 5100. 

5 The portions stored in the registers 5 1 04 1 -5 1 04 4 and 5 1 04 6 (not register 5 1 04 5 which 

stores ADDR_CRC) are fed to selectors 5106i-5 1 06 4 , and 5106 6 , respectively, as indicated. 
An exemplary one of the selectors 5106j-5106 4 , and 5106 6 „ here selector 5106 6 is shown to 
include four registers 5108i-5108 4 . The four registers 5108i-5108 4 are connected to the same 
input port I of the selector 5106 6 to thereby store four copies of the information portion, here 

10 the "tag" portion, fed to such input port I in this example. The output of each of the four 
registers 5108i-5108 4 is fed to a corresponding one of four gated buffers 51 10i-51 10 4 , 
respectively, as indicated. With such an arrangement, one of the stored four copies is 
coupled to a selected one of the output ports Ai - A 4 selectively (and hence to ports Wj-Zi, 
respectively) in accordance with enable memory control signals on lines EAW-EAZ as a 

15 result of decoding the two-bit portion of "tag" indicating the selected one of the four memory 
array regions Rj-Rj. More particularly, each one of the lines EAW-EAZ is coupled to a 
corresponding one of the enable inputs of the four gated buffers 51 10 r 51 10 4 , respectively, as 
indicated. 

More particularly, as noted above, the "tag" includes 2 bits which indicates the one of 
20 the four memory array regions Ri - R* which is to receive the information at port 5006i (i.e., 
the "tag", the ADDR_CRC, the ADDR, the memory control, the DATA, and the 
DATA_CRC ). The "tag" is fed to a memory control logic/ADDR_CRC checker 5112. In 
response to this two bit portion of the "tag", the memory control logic/ADDR CRC checker 
5112 activates one of the four lines EAW-EAZ to thereby enable a selected one of the four 
25 copies stored in the four registers 5108 r 5108 4 to pass to one of the ports Ai -A 4 . It is noted 
that the lines EAW-EAZ are also fed to selectors 5106i-5106 5 in a similar manner with the 
result that the information at port 5006i (i.e., the "tag", the ADDR_CRC, the ADDR, the 
memory control, the DATA, and the DATA_CRC) portions Data CRC, Data, memory 
control, ADDR, and ADDR_CRC is fed to the same selected one of the ports Aj -A 4 and thus 
30 to the one of the four memory array regions Rj-JU described by the two-bit portion of the 
"tag". 
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fr^ - r^frvl fo pt npp^pnrt qnrtiW A nkn include^ a mpmnry hmrH ^ 4ffidger^4^ 

Each of the here eight memory board 220i-220 8 (FIG. 8) plugs into the backplane 3026s 
discussed above in connection with FIG. 3. As noted above, here the backplane 3QZ is 
adapted to a plurality of, here up to eight memory boards. Thus, here the backplane 302 has 
5 eight memory board slots. Pins P1-P3 (FIG. 9) are provided for each backplane 320 memory 
board slot and produce logic voltage levels indicating the slot position in.tne backplane. 
Thus, here the slot position may be indicated with the logic signals op'the three pins P1-P3 to 
produce a three bit logic signal representative of the backplane sLat position. Referring again 
to FIG. 9, the exemplary memory board 220 1 is shown plugg^a into a slot in the backplane 
10 302. As noted above, the slot has pins P1-P3 which provides the slot position three bit logic 
signal indicative of the slot or "memory board" number in the backplane. The logic signals 
produced by the pins P1-P3 are fed to the memorv#oard checker 51 14 (FIG. 1 1). Also fed to 
the memory board checker 51 14 are the 3-bits^f the "tag" which indicates the one of the 
memory array boards which is to receive tiafe data (i.e., a 3-bit "memory board code"). If the 
15 three bit memory board indication proyfded by "tag" is the same as the backplane slot or 
"memory board number" indicatiop'provided by the pins P1-P3, the director routed the 
information cycle to the propet/one of the eight memory boards and such "accept" indication 
is provided to the decode lo^ic/ADDR CRC checker 5 1 12 via line A/R. On the other hand, if 
the three bit memory bpdrd indication provided by "tag" is different from the backplane slot 
20 indication provided jay the pins P1-P3, the information cycle was not received by the correct 
one of the memory boards and such "reject" indication is provided to the decode logic/ADDR 
CRC checker 5^12 via line A/R. When a reject indication is provided to the decode 
logic/ADDR/CRC checker 51 12, the intended transfer in prevented and the indication is 
provided by the decode logic/ADDR CRC checker 5 1 12 to the initiating director via the A/R 
25 line. Thus, if the "memory board number" provided by pins P1-P3 does not match the 

"memory board code" contained in the "tag" the transfer request from the director is rejected 
and such error indication is sent back to the director. In this manner, a routing error in the 
ah^Gtotds ^etected^ffi m Gdiatolv a nd-t s not propagated alongr au. 

On the other hand, if the "memory board number" and the "memory board code" do 
30 match, the crossbar switch will forward the requested transfer to one of the four memory 
regions (i.e., the "memory region number", R1-R4) designated by the "tag". 
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The decode logic and ADDRCRC checker 5112 also produces load signals Li-L 6 to 
the registers 5 104 1-51 04 6 , respectively, in response to the "start-frame" signal in word 0 
described above in connection with FIG. 16 

Also fed to the decode logic/ADDR_CRC checker 51 12 is the ADDR CRC portion 
5 stored in registers 5 1 04 3 5 1 04 6 (i.e., control, ADDR, ADDR CRC, and "tag"). The decode 
logic/ADDR_CRC 5 1 12 performs a check of the CRC of the control, ADDR, ADDR CRC, 
and "tag" and if such checker 5112 detects an error such error is reported back to the transfer 
initiating director via line ADDR_CRC_CHECK, as indicated. Detection of such an 
ADDR_CRC_CHECK error also results in termination of the transfer. 
10 When data is read from a selected one of the memory array region R1-R4 as indicated 

by the "tag" stored in register 51 04 6 , the decode logic/ADDR_CRC checker5112 activates 
the proper one of the lines EAW-WAZ to coupled the proper one of the ports A1-A4 coupled 
to such selected one of the memory array regions Ri-R4to a register 5120. Thus, read data 
passes via selector 51 18 to the register 5120 and is then sent to the transfer-requesting 

director via pot 5006i. 

^^tt^n^rOr^^ and AnnR -C KC rtnfl IIP in nppnr port intrrf ni fo 

logic A also produces request signals RWA, RXA, RYA, and RZA and sends such request 
signal to lower port sections W-Z, respectively. Such requests are fed to an arbitration logic 
5114 (FIG. 12) included within each of the lower port sections W, X, Y and^respectively. 
20 Thus, because the other upper port sections B-D operate in like mannerto upper port section 
A, the arbitration 51 14 in lower port interface section W ma^eceive requests RWB, RWC, 
and RWD from such other upper port sections B-D, respectively. In accordance with a 
predetermined arbitration rule, such as, for exajnple, first-come, first-served, the arbitration 
logic 5 1 1 4 of lower port interface sectipn^W grants for access to lower port 5 008 1 of lower 
25 port section W to one of the requesting upper port sections A-D via a grant signal on one of 
the lines GWA, GWB, GWCand GWD, respectively. 

Thus, referring again to FIG. 1 1, the decode logic/CRC ADR checker 5112 issues a 
request on HneRWA when port 5008 1 (FIG. 10) desires, based on the two bit information in 
the "tag^'fmemory array region Ri (FIG. 9). In like manner, if memory array regions R2-R4 
30 aredndicted by the "tag", requests are made by the upper port section on lines RXA, RYA, 
RZA, respectively. The other upper port sections B-D operate in like manner. The grants 
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(GR) produced by the lower port sections W, X, Y and Z are fed to the upper port ^gtfons A- 
D as indicated above. Thus, considering exemplary upper port section A (FIG/fl ), the grant 
signals from lower port sections W-Z are fed to the decode logic/CRC checker 51 12 therein 
on lines GWA, GXA, GYA and GZA, respectively. When a grantpn'one of these four lines 
GWA, GXA, GYA and GZA is received by the decode logjp/CRC checker 5112, such 
checker 5112 enables the gating signal to be produ^etfon the one of the enable lines EAW, 
EAX, EAY, EAZ indicated by the "tag" porjiou For example, if the "tag" indicates that 
memory array region R3 (which isjjdapled for coupling to port 5OO83 of lower port section Y) 
the checker 5112 issues a request on line RYA. When after the arbitration logic 5 1 1 4 in 
section Y determines-mat lower port logic A is to be granted access to port 5008 3 , such lower 
port section^tssues a grant signal on line GYA. In response to such grant, the checker 5112 
issue^-anenable signal on line EAY to thereby enable information to pass to port A 3 (FIG. 



5= 




In a reciprocal manner, when data is to be transferred from a memory array region to 
the requesting director, the information sent by the requesting director is processed as 
described above. Now, however, the checker 51 12 sends a control signal to one of the lines 
EAW-EAZ to selector section 5 1 1 8 to enable data on one of the ports A1-A4 coupled to the 
addressed memory array regions R1-R4 to pass to register 5120 and then to upper port 5006i. 

^p^^p^ujtcL^IG 1 \ f ypmpjary lower port sertion W is shewrrtQ^Bfifade — 
arbitration logic 51 14 described above, and the selector 5120 fed by signak^n ports W r W 4 . 
(Referring again to FIG. 10, ports WpW 4 are coupled to ports A^BuCi and Di, 
respectively, of upper port interface sections A-D, respeetively.) Thus, when the arbitration 
logic 5114 grants access to one of the uppeppoffsections A-D, the decoder 5122 decodes the 
grant information produced by the>ait5rttation logic and produces a two bit control signal for 
the selector 5120. In response to the two bit control signal produced by the decoder 5122, 
the selector couptefone of the ports W1-W4 (and hence one of the upper port sections A-D, 
respectively), to the output of the selector 5120 and hence to lower port 5008] in a manner to 



As noted above, the communication between any port M B i-M B 8, M A i-M A 8 and its 
30 corresponding crossbar switches 5004i-5004 4 is protected by Cyclic Redundancy Check 

(CRC) defined by CCITT-V.41 . The communication between a crossbar switch 5004i-5004 4 



34 



and its corresponding memory array region R1-R4 is protected by byte parity (p). There is a 
pipelined architecture from the port M B i-M B 8, M A i-M A 8, and through the crossbar switch, 
and through the logic sections 5010i-5010g. 

The nature of CRC calculation is such that an error in the data is not detected until the 
entire transfer is completed and the checksum of the CRC is known. In the case of a write of 
data into the memory, by the time the CRC is checked, most of the data is already through 
the pipeline and written into memory. 

Here, the memory control field has a specific bit "Wait and Validate" in the control 
word 1 in FIG. 16 which is at the director's control. If the bit is set, the logic sections 5010i- 
5010 8 buffers the entire information cycle, pending the CRC calculation, performed at the 
lower port interface sections W-Z. If the CRC check indicates no CRC error, then the data is 
written into the memory array region. If the CRC check does indicate an error, then the 
memory array region is informed of the error, here by the lower interface section W-Z 
corrupting the data into a fault. Such fault is detected in the logic section 5010 r 5010 8 and 
such information is prevented from being stored in the memory region R1-R4 , in a manner to 
be described. Suffice it to say here, however, that this "Wait and Validate" technique enables 
the director to flag certain data transfers as critical, and if an error occurs, prevents corruption 
of the data stored in the memory array. That is, the data having a CRC error is detected and 
prevented from being stored in the memory array region. For those transfers not indicated as 
critical by the director, the "Wait and Validate" bit is not set thereby maximum performance 
of the memory is obtained. 

J^ore-p articular l y , t he -BAT-Arm emory con t rol , ABDR 7 «Bd- ! Hag" pui lions 
byte parity (p) generated by parity generator 5102 (FIG. 1 1)) of the information coupled to 
the output of selector 5120 is stored in the register 5124. As noted above incpmiection with 
FIG. 16, the DATACRC portion (i.e., the words X and Y) occurs aftejHne last DATA word. 

Thus, as the words in the DATA clock through register5T24 they pass into the 
DATA CRC checker 5132 where the CRC of th^DATA is determined (i.e., the 
DATACRC checker 5132 determjne^-alidY words of the DATA fed to such checker 
5132). The actual Xjnd^vv6rdT(i.e., DATA CRC stored in register 5128, both content (n) 
and parjty-tp^Jare stored successively in register 5 128 and are then passed to checker 5 132 
where they are checked against the X and Y words determined by the checker 5 132. As 
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noted above, the DATA has appended to it its parity (p). Thus, the "information" whether in 
register 5124 or register 5128 has a content portion indicated by "n" and its parity indicated 
by "p". Thus, the DATA_CRC register 5128 includes the DATA_CRC/previously stored in 
register 5104i (FIG. 1 1) (i.e., the content portion designated by "n") and its parity (designated 

5 by "p"). The DATA, memory control, ADDR, and "tag" portions, /with their parity (p) (i.e., 
content "n" plus its appended parity "p") stored in register 5124 riiay be coupled through a 
selector 5 149 through one of two paths: One path is a direct pam when the "Wait and 
Validate" command is not issued by the director; and, a second path which includes a delay 
network 5130, here a three clock pulse delay network 513GL 

10 More particularly, it is noted that the DATA, control, ADDR, "tag", both content (n) 

and parity (p) are also fed to a DATACRC checker 5432. Also fed to the DATA_CRC 
checker 5132 is the output of DATA_CRC register/l28. The CRC checker 5132 checks 
whether the DATA_CRC (content "n" plus its parity "p") is the same as the CRC of the 
DATA, such DATA having been previously stored in register 5104 2 (FIG. 1 1), i.e., the 

1 5 content "n" plus its parity "p" of the DATA previously stored in register 5 1 04 2 (FIG. 11). If 
they are the same, (i.e., no DATA CRC .ERROR), a logic 0 is produced by the CRC checker 
5132. If, on the other hand, they are not the same, (i.e., a DATA_CRC_ERROR), the CRC 
checker 5132 produces a logic 1 . The output of the Data_CRC checker 5 1 32 thereby 
indicates whether there is an error/in the CRC of the DATA. Note that a 

20 DATA_CRC_ERROR is not tafown until three clock cycles after the last sixteen-bit portion 
of the DATA (i.e., the word ,o4 the DATA, FIG. 16) is calculated due to the nature of the 
CRC algorithm. Such indication is fed to a selector 5152 via an OR gate 5141. If there is a 
DATA_CRC_ERROR/uie "information" at the output of the delay network 5130 (i.e., the 
last word of the DATA (FIG. 16)) with its parity (p)) is corrupted. Here, the content (n) of 

25 such "information/ ;i.e., the "information" at the output of the delay network 5130 (i.e., the 
last word of the^DATA (FIG. 1 6))) is fed to a second input I 2 of the selector 5 140. The parity 
(p) of such 'information" (i.e., the last word of the DATA (FIG. 16)) is fed non-inverted to 
one input /f selector 5152 and inverted, via inverter 5150, to a second input of the selector 
5 1 52. Inhere is a DATA_CRC_ERROR detected by data CRC checker 5 1 32, the inverted 

30 parity is passed through the selector 5 1 52 and appended to the content portion (n) of the 
"information" (i.e., the last word of the DATA (FIG. 16)) provided at the output of the delay 
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network 5130 and both "n" and appended "p" are fed to the second input I 2 of selectop"5140 
thereby corrupting such "information". It should be noted that the remaining portions of the 
information cycle (i.e., the memory control, address (ADDR), "tag", and all but the last word 
of the DATA (FIG. 16)) pass through the delay network 5130 without havirfg their parity (p) 

5 corrupted. / 

If there is a no "Wait and Validate" transfer, logic decoder 5122selects the first input 
Ii as the output of the selector 5140. If there is a "Wait and Validaj/ transfer, the logic 
decoder 5122 selects the second input I 2 as the output of the selector 5140. It is noted, 
however, that that because the last word of DATA (FIG. 16) is delayed three clock pulses 

10 (from Clock 1) by registers 5142, 5144, and 5146 (such registers 5142, 5144 and 5146 being 
fed by such Clock 1), the DATACRC check is performed before the last word of the DATA 
appears at the output of register 5146. Thus, the last/vord of the DATA is corrupted in byte 
parity before being passed to the logic section 5OH)i-5010 8 . That is, because of the delay 
network 5130, the DATA_CRC is evaluated before the last word of the DATA has passed to 

15 port 5008i. This corruption in parity (p), as a result of a detected DATA_CRC error, is 
detected by a parity checker 6106 (FKJ: 14) in the following logic section 5010i-5010 8 in a 
manner to be described. Suffice mo say here, however, that detection of the parity error 
(produced by the detected CRC error) prevents such corrupted information from storage in 
the SDRAMs. / 

20 On the otheHiand, if there is no DATA CRC ERROR (and no error in the parity of 

the DATA CRCdetected by the parity checker 6106 (FIG. 14) in a manner to be described) 
the non-ipverted parity (p) is appended to the "information" (i.e., DATA, memory control, 
ADDlCand "tag") provided at the output of the delay network 5130 and such information is 
fnlt n llic pioj n i memory n rid r m r egion P i P i n n i ndi ca ted by "t ftf"- r 

25 More particularly, it is noted that the selector 5 140 is also fed the "information" (i.e., 

DATA, memory control, ADDR, and "tag") without such "information" passing through the 
delay 5130. The director issuing the transfer may not require that the transfer have the 
DATA CRC check result preclude the writing of information into the memory (i.e., no "Wait 
and Validate"), in which case the "information" is passed directly through the selector 5140. 

30 On the other hand, if such D ATA_CRC check is to be effected, the delay network 5130 
output, with a possible corruption as described above, is passed through the selector 5140. 
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The director provides the indication as part of the control field in the described "Wait and 
Validate" bit. Such bit is decoded by the logic decoder 5122. In response to such director 
indication, a "Wait and Validate" control signal is sent by the logic decoder 5122 to the 
selector 5140. 

As noted above, the communication between any port and its corresponding crossbar 
switch is protected by Cyclic Redundancy Check (CRC) defined by CCITT-V.41 . The 
communication between a crossbar switch and a memory array region R1-R4 is protected by 
byte parity (p). This implies that the crossbar switch must translate between CRC protection 
and parity protection. 

As a further check of the validity of the DATA CRC, the generated parity p of the 
CRC of such DATA is checked. However, because the CRC is generated by the director, 
and the CRC parity is also generated by upper interface section A-D, a CRC generation fault 
would yield an undetectable CRC parity fault. 

It has been discovered that the parity of the DATA_CRC must be the same as the 
parity of the DATA parityfrU Thus, one rnerely has to check whether the parity of the 
DATA_CRC is the same as the parity of the DATA parity^). Therefore, such detection 
DATA_CRC parity checking method/is accomplished without using the D ATA_CRC itself. 

More particularly, since the ^JATA over whichtfie DATA_CRC is being calculated is 
already parity protected, one can use the DATA parity (pj/to calculate the DATA_CRC 
parity: i.e., the DATACRC parity is equal to the parity of all the DATA parity bits. Still 
more particularly, if there are NJbytes of DATA: 
[D(0),D(1),...D(N-1)] 

and each byte is protected by a parity bit p, then the DATA CRC parity is the parity 

of 

r \[p(0),p(l),.7p(N-l)]. 
Thus, if there is a faMt in the generation of the DATA CRC, it is immediately 
detected and isolated from the director. 

^tftexxemplary lowef ^ortinterrae^ ^tioirw" (FIC^42) inolude s-a-parfty. 
generator made up of an exclusiveQR-gate5134 and register 5136 arranged as shown fed by 
the parity (p) of theJMTA~ix>rtion stored in register 5 124. The generated parity p is fed to a 
comBaratofBTslfalong with the parity (p) of the DATA_CRC (i.e., DATA_CRC_PARITY), 
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as indicated. If the two are the same at the end of the DATA portion of the information cycle 
(FIG. 16), a logic 0 is produced by the comparator 5138 and such logic 0 passes w the 
selector 5152 to enable the non-inverted parity to pass through such selector 51/52. If there is 
an error in the parity bit of the CRC, a logic 1 is produced by the comparator 5138 and the 

5 inverted parity is passed through the selector 5 1 52. The logic 1 output of^eomparator 5138 
passes through OR gate 5141 to couple the inverted parity (p) through/selector 5152 to 
append to the content port (n) of DATA control, ADDR, and "tag"^t port I 2 of selector 5140. 
Thus, if there is either a DATA_CRCJERROR or if D ATA_CR£_P ARIT Y is different from 
parity of the DATA_PARITY at the end of the DATA portioft of the information cycle as 

10 indicated by a signal produced on line COMP_ENABLE py the logic decoder 5 1 22, a logic 1 
is produced at the output of OR gate 5141 thereby coujafling the inverted parity through 
selector 5152. Otherwise, the non-inverted parity passes through selector 5 1 52. That is, the 
COMPEN is produced at the end of the DATA in the information cycle (FIG. 16). 

It is noted that information read from me memory region passes to a register 5 1 70 and 

1 5 a CRC generator 5 1 72. The generated CROis appended to the information clocked out of the 
register 5170. Four copies of the information with appended CRC are stored in registers 
5174i-5174 4) respectively. In response to the "tag" portion fed to logic decoder 5122, a 
selected one of the registers 51741^51 74 4 is coupled to one of the port W1-W4 by selector 
5 1 80 and gates 5 1 82i-5 1 82 4 in ^manner similar to that described in connection with FIG. 1 1 . 

20 Referring now to FIG/l3 a pair of the logic sections 5010i-5010g (memory array 

region controllers), here logic sections 5010i and 50102 are shown. As noted above in 
connection with FIG. 9/both logic sections 5010i and 5010 2 are coupled to the same memory 
array region, here memory array region Ri. As was also noted above in connection with FIG. 
9, the logic section 5010i is in one fault domain, here fault domain A, and logic section 5010 2 

25 is in a differertfTault domain, here fault domain B. Thus, logic section 501 0i operates in 
response to eflock pulses from Clock 1 and logic section 5010 2 operates in response to clock 
pulses from Clock 2. 

/As noted above, each logic section 5010i-5010 8 (FIG. 9) includes a pair of upper 
porfe( A and B, a control port C and a data port D. Referring to FIG. 13, an exemplary logic 

30 section 501 0i is shown in detail to include a upper port A controller 6002 A coupled to upper 
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Both port A and port B controllers 5010i, 5010 2 have access to the data stored in the 
same memory array region Ri. Further, while each can provide different, independent 

5 control and address information, (i.e., memory control, ADDR, and "tag" (hereinafter 
sometimes referred to as ADDR/CONTROL)), both share the same DATA port. As noted 
above, the details of the memory array region 1 are described in detail in connection with 
FIG. 6 of U. S. Patent 5,943,287. Thus, arbitration is required for access to the common 
memory array region Ri when both the port A and port B controllers 5010i and 5010 2 desire 

1 o access to the memory array region Ri . Further, the SDRAMs in the memory array region Ri 
require periodic refresh signals from the memory refresh section 6002R. Thus, access or 
request for, the memory array region Ri may come from: the upper port A controller 6002A 
(i.e., REQUEST A); the upper port B controller 6002B (i.e., REQUEST B); and from the 
memory refresh section 6002R (i.e., REFRESH REQUEST). These request are fed to an 

15 arbitration logic 6004 included within the logic section 5010i-5010 8 . The arbitration sections 
6004i, 6004 2 in the redundant paired logic sections, here logic sections 5010i, 5010 2 , 
respectively, arbitrate in accordance with an arbitration algorithm to be described and thereby 
to issue a grant for access to the memory array region Ri to either: the upper port A controller 
6002A (i.e., GRANT A); the upper port B controller 6002B (i.e., GRANT B); or the memory 

20, refresh section 6002R (i.e., REFRESH GRANT). 

■to \ 

tfererthe-atfeitraJiML^ is ail dsy u u i i d m ^^ otm d r obin sharing-uf ilic common- 

J^niemory array region Ri. The arbifrationjo^kr^0O4^6OO4 2 and the algorithm executed 
therein will be described injnore^etail in connection with FIG. 15. Suffice it to say here 
however thailhe-afBlfration grants access to the common memory array region based on the 
25 f bttrjwing oondition s* 

Condition I - If both the logic sections 5010i and 5010 2 are 
operating properly (i.e., produce Memory Output Enable (MOE) and 
Memory Refresh Enable (MRE) signals, to be described, properly), the 
30 port A controller 6002A memory refresh controller 6002R is used 

exclusively for memory refresh during the round-robin arbitration). 
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Thus, there is asymmetric round robin arbitration because the memory 
refresh section 6002R of logic section 5010 2 is not used when 
operating in this normal Condition I. The states of the arbitration 
sequences are as follows: 
5 State 1 -The upper port A controller 6002 A of logic section 

5010i is granted access to the memory array region Ri; 

State 2-The memory refresh section 6002R of logic section 
5010i is granted access to the memory array region Ri; 

State 3-The upper port B controller 6002B of logic section 
10 50 1 0 1 is granted access to the memory array region Ri ; 

State 4-The memory refresh section 6002R of logic section 

50101 is granted access to the memory array region Ri; 

State 4- A check is made as to whether the of logic section 

50102 requests access to the memory array region Ri. If such a request 
15 exist: 

(a) The upper port A controller 6002A of logic section 
5OIO2 is granted access to the memory array region Ri if such 
access is requested; 

(b) The upper port B controller 6002B of logic section 
20 501 02 is granted access to the memory array region Ri if such 

access is requested; 

State 5-The process returns to State 1 . 

(It should be noted that the process uses the memory refresh 
25 section 6002R of logic section 5010i but does not use the memory 

refresh section 6002R of logic section 5010 2 . Thus the round robin is 
asymmetric.) 

Condition II - If the logic section 5010 2 is disabled (i.e., does not 
produce MOE and MRE signals properly), the logic section 5010 2 is 
30 not part of the round-robin arbitration and memory refresh is provided, 

as in Condition I, exclusively by the logic section 5010i memory 
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refresh controller 6002R. The logic section 5010i no longer receives 
request signals FROM the logic section 50102. Also the logic section 
5010] is granted access to the memory array region R t all the time. 
Thus, the states of the arbitration sequence are in Condition II as 
follows: 

State 1-The upper port A controller 6002 A of logic section 
5010i is granted access to the memory array region Ri; 

State 2-The memory refresh section 6002R of logic section 
5010i is granted access to the memory array region Rj; 

State 3-The upper port B controller 6002B of logic section 
5010i is granted access to the memory array region Ri; 

State 4-The memory refresh section 6002R of logic section 
5010i is granted access to the memory array region Rj; 

State 5-The process returns to State 1 . 

Condition IH -The logic section 5010i is disabled (i.e., does not 
produce MOE and MRE signals properly) and thus the logic section 

50101 is not part of the round-robin arbitration. Memory refresh is 
provided exclusively by the memory refresh section 6002R (not 
shown) in the logic section 5010 2 . The logic section 5010 2 is granted 
access to the memory array region Ri all the time. Thus the states of 
the arbitration sequence in Condition III are as follows: 

State 1-The upper port A controller 6002A of logic section 

50102 is granted access to the memory array region Ri; 

State 2-The memory refresh section 6002R of logic section 
5OIO2 is granted access to the memory array region Ri; 

State 3-The upper port B controller 6002B of logic section 
5010 2 is granted access to the memory array region Rj; 

State 4-The memory refresh section 6002R of logic section 
5010 2 is granted access to the memory array region Ri; 

State 5-The process returns to State 1 . 

42 



Condition IV -Reset (the arbitration is reset into Condition I 
from either Condition II or from condition III). 

Refemn g again to FIG . 1 M h e a r bitration logic 6001 1, 6001/ in oach on e of thcr bgt^ 
sections 5010i, 50102 produces: a memory output enable (MOE) signal; a memory refresh 
enable (MRE) signal (to be described in more detail in connection with FIGS. 15 and Y9)\ 
and, a memory grant (MG) signal, (to be described in more detail in connection witja FIGS. 
15 and 19). Thus, logic section 5010i produces a memory output enable signal MOEA (to be 
described in more detail in connection with FIGS. 15 and 19), a memory refresn enable 
signal MRE A (to be described in more detail in connection with FIGS. 15 arfcl 19) and a 
memory grant signal MGA (to be described in more detail in connection xvith FIGS. 15 and 
19). Likewise, logic section 5OIO2 produces a memory output enable^ignal MOEB (to be 
described in more detail in connection with FIGS. 15 and 19), a memory refresh enable 
signal MREB (to be described in more detail in connection vnm FIGS. 15 and 19) and a 
memory grant signal MGB (to be described in more detail in connection with FIGS. 15 and 
19). Suffice it to say here, however, that the MOEA sigrml is a triplicate signal MOEm, 
MOE1-2, MOE1.3 and the MGA signal is also a triplicate signal MGEia, MGEha, and MGEm A . 

The MOEA and MREA signals from the^ogic section 5010i and the MOEB and 
MREB signals from the logic section 5010 2 are fed to a watch dog (WD) section 6006, to be 
described in more detail in connection wjmFIG. 15. Suffice it to say here, however, that, as 
noted above, the arbitration dgorithm^s a function of the operating/non-operating condition 
of the logic sections 5010i, 5010vThis operating/non-operating condition is determined by 
the watchdog section 6006 anymore particularly by examining the MOEA, MREA, MOEB, 
MREB signals produced b/the logic sections 5010j and 5010 2 , 6002B, respectively. The 
MOEA, MREA, MOE^, MREB signals are asserted when there is a grant. Such signals 
MOEA, MREA, MOEB, MREB are fed to the watchdog section 6006. As will be described, 
the watchdog^ction 6006 examines the time history of these signals to determine if the 
logic sectidn 5010i or 5OIO2 asserting them is operating properly. Based on the results of 
such elimination, the watchdog selects the Condition I, Condition II, or Condition III, 
described above. 
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More particularly, consider, for example, a case where the MOEA signal is as^rted 
for too long a predetermined time interval. It should be recalled that the logic section 5010i 
producing such MOEA signal is granted access to the memory in State 1 of the/normal 
arbitration condition (i.e., Condition I, above). The watchdog section 6006 thus detects a 

5 fault in logic section 5010i. When such a fault is detected, the watchdog/section 6006 issues 
a Condition III signal on in triplicate on lines MSAB to the arbitration/ections 6004 u 6004 2 
in both the logic sections 5010i, 5010 2 , respectively, indicating thaHhe arbitration algorithm 
will operate in accordance with the States set forth above for Condition III. Further, the 
watchdog 6006 issues a data output enable signal in triplicate on lines DOEA (i.e., DOEA 0 , 

10 DOEAi, and DOEA 2 ). This triplicate signal DOEA (i^DOEA 0 , DOEAi, and DOEA 2 ) is 
fed to a majority gate (MG) 6007 (FIG. 13), in accordance with the majority of the triplicate 
data fed to it, provides an enable/disable signaLfor gate 6009. If the majority indicates a 
fault, the gate 6009 inhibits DATA from panging between the logic section 5010i and the data 
port D thereof. / 

15 Consider the case where thearoitration is in Condition L Consider also that in such 

condition I, the MREA signal is^ot produced after a predetermined time interval which 
ensures proper refreshing on^me SDRAMs in the memory array region Ri. The watchdog 
section 6006 will agaiirdetect a fault in the logic section 5010i port A controller 6002A. 
When such a fault ^detected, the watchdog section 6006 issues a Condition III signal on in 

20 triplicate on line^MSAB (i.e., MSAB 0 , MSABi, MSAB 2 ) to the arbitration sections 6004i, 
6004 2 in bojKthe logic sections 5010i, 5010 2 , respectively. Further, the watchdog 6006 
issues a/Iata output enable signal in triplicate on lines DOEA (i.e., DOEAo, DOEAi, and 
DOpA 2 ) (FIG. 13) to inhibit DATA from passing between the logic section 5010j and the 
^e fcta - port D 4 hcrcofc-« 

25 Consider, for example, a case where the arbitration is in Condition I and the MOEB 

signal from the logic section 5010 2 is asserted for too long a predetermined time interval. 
The watchdog section 6006 thus detects a fault in the logic section 5010 2 . When such a fault 
is detected, the watchdog section 6006 issues a Condition II signal on line MSAB to the 
arbitration sections 6004], 6004 2 in both the logic sections 5010i, 5010 2 . Further, the 

30 watchdog 6006 issues a data output enable signal in triplicate on lines DOEB to inhibit 
DATA from passing between the logic section 5010 2 and the data port D thereof. 
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It should be noted that the algorithm allows a transition between Condition II and 
Condition IV (i.e., reset) or from Condition III and Condition IV. 

Thus, the arbitration logics 6004 1 and 6004 2 are adapted to issue the following 

signals: 

GRANT A (GA)-grant port A controller 6002B access to the memory array region Ri ; 
GRANT B (GB)-grant port B controller 6002B access to the memory array region Ri 
REFRESH GRANT (GR)-grant the memory refresh section 6002R of logic section 
501 0i access to the memory array region Ri in Condition I and II or grant the memory 
refresh section 6002R of logic section 5010 2 access to the memory array region R\ in 
Condition III. 

It should be noted that the details of GA and the other signal GB and GR are shown in 
more detail in connection with FIG. 19. 

3 hm, referring to FIG. 13, tho memory array region R T-inay-be-6eupled-te-^y- 
Port_A (A) or Port_B (B) of the logic sections 5010i, 5010 2 or to the memory refresh section 
6002R therein selectively in accordance with a Port A SELECT, Port_B_SEJiECT , 
Port R SELECT signal fed to a pair of selectors 6010 c , 6010 D , shown irynore detail for 
exemplary logic section 5010]. Access by the upper port A controllep6002A (i.e., Port_A), 
by the upper port B controller 6002B, or the memory refresh section 6002R to the memory 
array region Ri is in accordance with the algorithm described above 

An exemplary one of the upper port A and pprfB logic controllers 6002 A and 6002B, 
here controller 6002 A, will be described in more'detail in connection with FIG. 14. Suffice it 
to say here, however, that it is noted thaUheoutput of selector 6010 c is coupled to the 
control port C of the exemplary logic^ection 5 101 1 and the output of selector 6010 D is 
coupled to the data port D of the'exemplary logic section 5 101 1 through the gate 6009. Each 
one of the selectors 6010c,and 6010 D has three inputs A, B. and R, as shown. The A, B and 
R inputs of selector 6QW C are coupled to: the ADR/CONTROL produced at the output of 
upper port A conteoller 6002A; the ADR/CONTROL produced at the output of upper port B 
controller 6002B; and, the portion REFRESH_C of the refresh signal produced by the 
memory refresh section 6002R, respectively as indicated. The A, B and R inputs of selector 
6010D^re coupled to: the WRITE DATA produced at the output of upper port A controller 
6002A; the WRITE DATA produced at the output of upper port B controller 6002B; and, the 
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portion REFRESH_D of the refresh signal produced by the memory refresh sectipir6U02R, 
respectively as indicated. The Port__A_SELECT, PortBSELECT arepreduced by the 
upper port A controller 6002A, upper port B controller 6002B in^fnanner to be described. 
The PortRJSELECT signal is produced by the memory re^sh section 6002R in a manner 
5 to be described to enable proper operation of the abov^described arbitration algorithm and to 
proper a refresh signal to the SDRAMs in the meprory array region Ri at the proper time. 
Suffice it to say here, however, that when pOTfA controller 6002A produces the 
Port A SELECT signal, the ADR/CONTROL at the output of port A controller 6002 A 
passes to the output of the selector 6P10C and the DATA_WRITE at the output of the port A 
10 controller 6002 A passes to the otffput of the selector 6010D. Likewise, when port B 

controller 6002B produces^ Port_B_SELECT signal, the ADR/CONTROL at the output of 
port B controller 6002p'passes to the output of the selector 60 10C and the DATA WRITE at 
the output of the ntfrt B controller 6002B passes to the output of the selector 6010D. In like 
manner, whep^efresh memory section 6002R produces the Port_R_SELECT_C signal, the 
1 5 REFRESH C at the output of refresh memory section 8002R passes to the output of the 
sele^t6r 60 10C and in response to the Port__R_SELECT signal, the REFRESH D at the 
£pn fpf the rofrcoh memory ooction 80 02P. pafcbU b lu Ihermtput O f ' UnrsoluOtor 6&faB&g 
It is noted that data read from the memory array Rj (i.e., READ_DATA) is fed from 
the data port D to both the upper Port A controller 6002A and the upper Port B controller 
6002B. 

Referr mg - now to FIG. 1 4 , tho exemplary port A controller 6002A is shown in mo j& 
detail to include a Port A primary control section 61 OOP and a Port A secondary conjrm 
section 6100S. The two sections 61 OOP and 6100S are both coupled to port Alalia both 
implement the identical control logic. Thus, each one of the two sectjoflgolOOP and 6100S 
25 should produce the same results unless there is an error, her^^fiardware fault, in one of the 
two sections 61 OOP and 6100S. Such a fault is dejeetgcfby a fault detector 6102 in a manner 
to be described. ^^^^ 

Thus, referring to thg^efaUs of one of the two sections 61 OOP and 6100S, here 
section 61 OOP, itig^fstnoted that the information at Port_A is fed to a parity checker 6101 . 
30 It is noted^hatis there is an error in parity induced by the CRC check described in FIG. 12 in 
connection with selector 5152, such detected parity error is reported to a control and DATA 
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path logic 6112. In response to a detected pd^^err^o^ol and DATA path logic 6112 
prevents memory controj^ign^s^TgTsuppress the Column Address Select signal to the 
SDRAMs}^nr^em^roduced on the CONTROL_P line. Thus, absent control signal, 
^T TAwlll my tb e- aored 1 In tho memory region^ ■ 

5 The information at Port_A is also fed to a control register 6 1 04 for storing the 

memory control portion of the information at port A, an ADDR register 6106 for storing the 
address portion (ADDR) of the information at port A, a write data register 6108 (here a 
FIFO) for storing the DATA portion of the information at port A, such being the data which 
is to be written into the memory array region Ri. The control portion stored in register 6104 

10 is fed also to the control and data path logic 61 12. Such logic 6112 produces: a memory 
array region request Request_Port_A_Primary (RAP) signal when the control portion in 
register 6104 indicates that there is data to be stored in the memory array region Ri; a Port A 
Primary Select (Port_A_P_SELECT) signal when the grant has been issued thereto via a 
Grant_A__P signal (GAP) produced by the arbitration logic 6004i; and passes the control 

15 portion (CONTROL_P) stored in register 6104 to the output of the upper port A controller 
6002 A, as indicated. It should be noted that the port A secondary control section 6100S 
being fed the same information as the primary controller 61 OOP should produce the same 
signals: here indicated as a memory array region request Request_Port ASECONDARY 
(RAS) signal when the control portion in register 6104 indicates that there is data to be stored 

20 in the memory array region Ri; a Port A Secondary Select (Port_A_S_SELECT) signal when 
the grant has been issued thereto via a Grant_A_S signal (GAS) produced by the arbitration 
logic 6004i. 

The address portion stored in the ADDR register 6106 (ADDR P) is combined with 
the address portion ADDR_P stored in register 6106. Both CONTOL_P and ADDR_P are 

25 fed to a parity generator 6109 to produce ADDR/CONTROLP (which has both a content 
portion (n) and parity (p). The content portion (n) of ADDR/CONTROL_P is fed to a parity 
generator 6120 to generate byte parity (p f ) from the content portion (n) of 
ADDR/CONTROLP. The generated parity (p 1 ) is inverted by inverter 6122 and the 
inverted parity is fed to a first input Ii of the selector 6124. The content portion (n) of 

30 ADDR/CONRTOL P is combined with a parity (p) produced at the output of selector 61 24 
in a manner to be described. The parity (p) of ADDR/CONTROL_P is fed to a second input 
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h of the selector 6124 and such parity (p) is also fed to an exclusive OR gate 6130. Also fed 
to the exclusive OR gate 6130 is the parity (p) of the equivalent ADDR/CONTROLJS signal 
produced by the Port A secondary control section 6100S. As noted above, since both 
sections 600P and 600S are fed the same information and implement the same logic 
5 functions, ADDR/CONTROL_P should be the same as ADDR/CONTROL_S unless there is 
a hardware fault in one of the sections 61 OOP, 6100S. If there is a fault (i.e., if 
ADDR/CONTROLS and ADDR/CONTROLP are different), the exclusive OR gate 6130 
will produce a logic 1 and in the absence of a fault, (i.e., ADDR/CONTROL_S is the same as 
ADDR/CONTROL P), the exclusive OR gate 6130 will produce a logic 0. 

10 In like manner, the content (n) of ADDR/CONTROL P is fed to an exclusive OR 

gate 6128. Also fed to the exclusive OR gate 6128 is the content (n) of the equivalent 
ADDR/CONTROL_S signal produced by the Port A secondary control section 6100S. As 
noted above, since both sections 600P and 600S are fed the same information and implement 
the same logic functions, ADDR/CONTROL P should be the same as ADDR/CONTROLS 

15 unless there is a hardware fault in one of the sections 61 OOP, 6100S. If there is a fault (i.e., if 
ADDR/CONTROL S and ADDR/CONTROL P are different), the exclusive OR gate 6128 
will produce a logic 1 and in the absence of a fault, (i.e., ADDR/CONTROLS is the same as 
ADDR/CONTROL P), the exclusive OR gate 6128 will produce a logic 0. 

The outputs of exclusive OR gates 6128 and 6130 are fed to an OR gate 6126. Thus, 

20 if there is an error in either the content (n) or the parity (p), the OR gate produces a logic 1 ; 
otherwise it produces a logic 0. The output of OR gate 6126 is fed to a fault detector 6102 
which detects such a fault and reports such detected fault to the director. The output of OR 
gate 6126 is also fed as a control signal to selector 6124. If the OR gate produces a logic 1 
(i.e., there is a fault), the selector couples the inverted parity of input Ii to the output of 

25 selector 6124. This inverted parity is appended to the content (n) of ADDR/CONTROL_P to 
thereby corrupt such information. This corrupted information is detected by the memory 
array region and converted into a n no-operation M command as described in the above- 
referenced U. S. patent No. 5,943,287. On the other hand, if the OR gate 6126 produces a 
logic 0 (i.e., no fault), the non-inverted parity at input I2 of selector 6124 passes through 

30 selector 6124 and is appended to the content portion (n) of ADDR/CONTROL/P. 
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A similar check is made with the DATA to be written into the memory array region. 
Thus, the DATA in register 6108 of primary controller 6100P (WRITE_DATA_P) is fed to 
an exclusive OR gate 6116 along with the write DATA in the secondary controller 6100S 
(WRITE_DATA_S). (It is noted the data in the write register 6108 of the primary controller 
61 OOP (DATAWRITEP) is fed to output DATA_WRITE bus while the write data in the 
secondary controller 6100S (DATA_WRITE_S) is fed only to the exclusive OR gate 61 18.) 
Thus, the exclusive OR gate 6116 produces a logic 0 if WRITE_DATA_P and 
WRITEJDATA_S are the same and produces a logic 1 if they are different. The fault 
detector 6102 detects such logic 1 and reports the detected fault to the transfer requesting 
director. 

In like manner, a check is made of the DATA read (READDATA) from the memory 
array region R\ which becomes stored in Read data register 6119, here a FIFO. The 
READ_DATA is fed to a read data register (here a FIFO) for transmission to the director via 
Port_A. Such READ_DATA in register 6119 indicated as READDATAP is fed to an 
exclusive OR gate 6118. In like manner, secondary controller 6100S should produce the 
same signals on output RE AD_D AT AS . READDATAP and READDATAJS are fed to 
an exclusive OR gate 6118. Thus, the exclusive OR gate 61 18 produces a logic 0 if 
READ DATA P and READ DATA S are the same and produces a logic 1 if they are 
different. The fault detector 6102 detects such logic 1 and reports the detected fault to the 
transfer requesting director. 
\(\ JHs-n o t od that the RAP and PAS - signal3 - arc both s ent - to the^bitrfofon logic 6001^ 
(FIG 13) as composite signal REQUEST A. The arbitration sectipn < 6004i considers a valid 
request only if both signals RAP and RAS are the samg^ftilike manner, the arbitration logic 
6004 1 issues separate grant signals GAP andpASwhich are shown in FIG. 13 as a 
composite signal GRANTA. Li^ewi^TO and PORT_A_S_SELECT 

signals are both sent to^te'arbitration logic 6004i (FIG 13) as composite signal 
PORT A^SEfcfiCT. The arbitration section 6004 1 considers a valid request only if both 
signal s PQRT_A J » r SEfcBC T atrd PORTA_S _ SELECT arc th o s amo^ 

As noted above, the upper port B controller 6002B provides signals: RBP, GBP, 
PORT_B_P_SELECT, ADDR/CONTROL, DATA WRITE RBS, GBS, PORT B SELECT, 
and READ DATA, which are equivalent to RAP, GAP, PORT A SELECT, 
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ADR/CONTROL, DATA_WRITE, RAS, GAS, PORT A_SELECT, and READ_DATA, 
respectively, which are provided by the upper port A controller 6002A 

Referring now to -Fierr5rt h o arbitration logic c 600 1 1, 60 e4rofTft5iogio s ec tions 
5010i, 50102, respectively, are shown along with the watchdog section 6006. Ins first noted 
that the arbitration logic 6004 1, 60042 are identical in construction. / 
Arbitration logic 6004 1 is fed by: / 
REQUEST A (i.e., RAP, RAS) from upper port A controllep6002A of logic section 
5010, (FIG. 13); / 

REQUEST B (RBP, RBS) from upper port B controjler 6002B of logic section 5010i 
(FIG. 13); / 

REQUEST R from upper memory refresh section 6002R of logic section 5010) (FIG. 
13) (It is to be noted that the REQUEST R is made-up of two signals, each being produced 
by identical primary and secondary identical memory refresh units, not shown, in memory 
refresh section 6002R both of which have to {Produce the same refresh signal in order for the 
arbitration logic 6004i to respond to the refresh request). 
Arbitration logic 6004 2 is fed by/ 

REQUEST A from upper por/A. controller 6002 A of logic section 5010 2 (FIG. 13); 

REQUEST B from upper n6rt B controller 6002B of logic section 5010 2 (FIG. 13); 

REQUEST R from upper memory refresh section 6002R of logic section 5010 2 . 

As shown in FIG. 15/each one of the three request signals REQUEST A, REQUEST 
B, and REQUEST R, produced in logic section 5010i is fed, in triplicate, to three identical 
arbitration units, (i.e.^arbitration unit I, arbitration unit II, and arbitration unit III) in the 
arbitration logic 6Q04i of such logic section 501 0i, as indicated. (See also FIG. 19). 
Likewise, eadTone of the three request signals REQUEST A, REQUEST B, and REQUEST 
R, produced in logic section 5010 2 is fed, in triplicate, to three identical arbitration units, (i.e., 
arbitration unit I, arbitration unit II, and arbitration unit III, in the arbitration logic 6004 2 of 
s^^dfl gic - sec ti oi r 501 - 02^ts indicated? 

In response to such request signals, REQUEST A, REQUEST B, and REQUEST R, 
each arbitration unit I, II, and III determines from the three requests; i.e., REQUEST A, 
REQUEST B, and REQUEST R, fed to it and in accordance with the algorithm described 
above, whether upper port A controller 6002A, upper port B controller 6002B, or the 
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memory refresh 6002R is to be given access to the memory array region Ri. As noted above, 
the operating Condition (i.e., Condition I, Condition II, or Condition III) is a function of 
whether the logic section 5010i is operating properly and whether the logic section 50102 is 
operating properly. The watchdog section 2006 determines whether such logic sections 

5 5010i, 5010 2 are operating properly. More particularly, when the arbitration units I, II, and 
III make their decision, they also produce a memory output enable (MOE) signals MOEI, 
MOEII and MOEIII, respectively, (when either logic section 5010i or 5010 2 is to be granted 
access to the memory array region Rj) and a memory refresh signal MREs (i.e., MREI, 
MREII and MREIII, respectively, when memory refresh section 6002R is to be granted 

10 access to the memory array region Ri). Thus, MOE signals MOEIi, MOEIIi, and MOEIIIi 
are produced by arbitration units I, II, and III, respectively, in arbitration logic 6004 1. Also, 
MRE signals MREIi, MREIIi, and MREIIIi are produced by arbitration units I, II, and III, 
respectively, in arbitration logic 6004 1. In like manner, MOE signals MOEI 2 , MOEII2, and 
MOEIII2 are produced by arbitration units I, II, and III, respectively, in arbitration logic 

15 6004 2 . Also, MRE signals MREI 2 , MREII 2 , and MREIII 2 are produced by arbitration units I, 
II, and III, respectively, in arbitration logic 6004 2 . (See also FIG. 19). 

These signals are fed to each of three identical watchdogs, WDi, WDn. WDm as 
follows: 

The MOE and MRE signals produced by the arbitration unit I in arbitration logics 
20 6004! and 6004 2 (i.e., MOEIi, MOEI 2 , MREIi and MREI 2 ) are fed to watchdog WDi; 

The MOE and MRE signals produced by the arbitration unit II in arbitration logics 
6004i and 6004 2 (i.e., MOEIIi, MOEII 2 , MREIIi and MREII 2 ) are fed to watchdog WD n ; and 

The MOE and MRE signals produced by the arbitration unit III in arbitration logics 
6004i and 6004 2 (i.e., MOEIIIi, MOEIII 2 , MREIIIi and MREIII 2 ) are fed to watchdog WDm. 
25 Each one of the watchdogs I, II, III is implemented and arranged identical to perform 

the same logic functions; however, they preferably implemented with components 
manufactured independently of each other. Further, each one of the watchdogs I, II, and III 
operates in response to its own independent clock, i.e., Clock I, Clock II, and Clock III, 
respectively. Thus, each watchdog makes an independent determination as to whether these 
30 signals are in proper time and rate and thus, determine, in accordance with the "Condition 
algorithm 11 described above, the proper one of the Conditions (i.e., Condition I, Condition II, 
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or Condition III) for the system. An indication of the Condition is provided by each of the 
watchdogs WDi, WDn and WD m as a two-bit word MSABi, MSAB n , and MSABm, 
respectively. The two-bit word is produces as follows: 
00 = Condition I 
5 01 = Condition II 

10 = condition III 

11 = Reset (i.e., Condition IV) 

These three words MSABi, MSABn, and MSABm are fed to both arbitration logics 
6004i and 6004 2 , as indicated. It should be remembered that each one of the arbitration 
10 logics 6004 1 and 6004 2 (and hence the arbitration logics 6004 1 and 6004 2 therein), operate 
with a separate independent clock, Clock 1, and Clock 2, respectively. In order to 
synchronize the three words MSABi, MSABn, and MSABm are fed to logic section 5010i 
and fed to logic section 50 1 0 2 . Each one of the arbitration logics 6004i, 6004 2 has a 
synchronization filter 6200i, 6200 2 to be described. Suffice it to say here, however, that the 
15 filter 6200 1 produces corresponding signals MSABij, MSABn j, and MSABmj, 

respectively, and filter 6200 2 produce corresponding signals MSABi_ 2 , MSABn_ 2 , and 
MSABni_ 2 , respectively, as indicated 

The-sigmris- MSABi i , MS,\B rri7ttncH vlSABiii j, aie fed -tehfe^- arbit r a tion - a ratfrjp 
and III, respectively, in arbitration logic 6004i. In like manner, the signals MSABi ^ 
MSABn_ 2 , and MSABm_ 2 , are fed to the arbitration units I, II, and III, respectivgl^in 
arbitration logic 6004 2 . In response to such signals, each one of the arbitpatfcn units I, II, and 
III, makes an independent determination of whether logic section^OTOi (FIG, 13) or logic 
section 5010 2 will be granted access to the memory array region R\. A grant by logic section 
5010i to logic section 5010 2 is indicated by a MempFy^rant (MG) signal. Thus, arbitration 
25 units I, II, and III of logic section 5010i pmfktft Memory Grant signals MGIi, MGIIi, and 
MGIIIi, respectively. Such sigm^s-afefed to a synchronization filter 6202 2 in arbitration 
logic 6004 2 . The synchjuarrfz^ion filter 6202 2 operates as is constructed in the same manner 
as synchronizafckSnfilters 6200i and 6200 2 . In like manner arbitration units I, II, and III of 
logic/Section 5010 2 produce Memory Grant signals MGI 2 , MGII 2 , and MGIII 2 , respectively. 
30 Sitoh signals are fed to a synchronization filter 6202 1 in arbitration logic 6004i . The 
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Ttttci 0203^» 

Thus, considering exemplary synchronization filter 62022, such filter is fed by the 
three Memory Grant (MG) signals MGI2, MGII2, and MGIII2. as indicated. The three signals 
are stored in registers 62041, 6204II and 6204 III, respectively, in response to a clock pulse 
produced by the Clock 2. Each of the three registers 62041, 6204II and 6204 III, send the 
information stored therein to each of three majority gates MGI, MGII, and MGIII, 
respectively, as indicated. The majority gates produce an output which is the majority of the 
three inputs fed thereto. The outputs of the three majority gates MGI, MGII and MGIII are 
the arbitration units I, II and III, respectively, in the arbitration logic 60042, as indicated. 

More particularly, referring to FIG. 16, portions of arbitration logics 6004 1 and 60042 
are shown. The data to be fed to the output of arbitration logic 6004 1 is clocked into register 
7000 1 of arbitration I, register 7000 2 of arbitration II, and register 7000 3 of arbitration III 
simultaneously in response to the same clock pulse produced by Clock 1 . Thus, each of the 
registers 7000 1, 7000 2 , 7OOO3 should store the same data at the clock pulse produced by Clock 
1, as indicated in FIG. 18. The data is then fed to registers 7002 h 7002 2 , 7002 3 of filter 6202 2 
of arbitration logic 6004 2 . The data at the registers 7002i, 7002 2 , 7002 3 are stored therein in 
response to the same clock produced by Clock 2. Because of the data in registers 7000i, 
7000 2 , 7OOO3 arrive at registers 7002 h 7002 2 , 7002 3 with different delays as indicated in FIG. 
18, while the data in 7000i, 7000 2 7000 3 is the same, here the data stored in registers 7002i, 
7002 2 , 7002 3 may be different as shown in FIG. 1 8. The data stored in register 7002 1 is fed to 
majority gates (MGs) 7004i, 7004 2 and 7004 3 . The data stored in register 7002 2 is also fed to 
majority gates (MGs) 7004i, 7004 2 and 7004 3 . Likewise, the data stored in register 7002 3 is 
fed to majority gates (MGs) 7004i, 7004 2 and 7004 3 . Each one of the majority gates MGs 
produces an output representative of the majority of the logic signals fed thereto as indicated 
in FIG. 17. 

ft efeiTii i ^ 4 km ao FIG.70 rfeeifaree^fbifea tifl^ IL and HI of e x e mpl a ry A rb itrati o n 
logic 6004] are the signals fed thereto and produced thereby areshowai^ It is 

first noted that the primary signal REQUE§I^^ the secondary request signal 

REQUEST_A_S^R^S)-afe^ScEl^ in triplicate; one copy to each of the arbitrations I, II, 
and III, as hrtficated. The one of the triplicate RAP and RAS fed to arbitration I are fed to an 
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AND gate 8OOO1, a second one of the triplicate RAP and RAS fed to arbitration II arefed to 
an AND gate 8000 25 and the third one of the triplicate RAP and RAS fed to arbitration III are 
fed to an AND gate 8000 3 , as indicated. Likewise, the signals REQUEST J3P/(TIBP), and 
REQUESTBS (RBS) are each fed in triplicate; one copy to each of the art>ftrations I, II, 
and III, as indicated. The one of the triplicate RBP and RBS fed to arbitration I are fed to an 
AND gate 8002i, a second one of the triplicate RBP and RBS fed tp^bitration II are fed to 
an AND gate 8002 2 , and the third one of the triplicate RBP mi'RBS fed to arbitration III are 
fed to an AND gate 8002 3 , as indicated. As mentioned>fiefly above, there are two memory 
refresh units in the memory refresh section 6002JKFIG. 13). One, a primary unit (not 
shown), issues a request RRP and the othep/^secondary unit (not shown), issues a request 
RRS. Above, in connection with FlG/u, these two requests were considered as a composite 
request (REFRESH REQUESJ^to simplify the discussion presented above. Here, in 
connection with FIG. l^tKeindividual signals RRP, RRS are shown in more detail. Thus, 
the signals RRP, RJfcSare each fed in triplicate; one copy to each of the arbitrations I, II, and 
III, as indicatpd^The one of the triplicate RRP and RRS is fed to arbitration I are fed to an 
AND ga)t^8004i, a second one of the triplicate RRP and RRS fed to arbitration II are fed to 
an A^D gate 8004 2 , and the third one of the triplicate RRP and RS fed to arbitration III are 
Wto - an ANB-gate-8Q0%ras indicated* . 

Thus, in the case of each pair, in order for the request to be issued to the arbitration I, 
II, or III. the AND gate associated therewith must see the same request from both the primary 
signal and the secondary signal fed to it. 

jgagfi^a^^ pdiis^grmrts i ft ,, a prnm ev^t m l Ue MKu i5^fe> 

unit and a secondary grant to the secondary unit. Thus, each of the arbitrations I, Il^aful III 
issues: the primary and secondary grants (GAP and GAS, respectively) to Jhp<Port A primary 
control section 61 OOP (FIG. 14) and Port A secondary control secti^r6t00S of Port A 
controller 6002A; the primary and secondary grants^GtBP^nd GBS, respectively) to the Port 
B primary control section and Port A secopdar^control section of Port B controller 6002B; 
and the primary and secondaQ^^nte(GRP and GRS, respectively) to the memory refresh 
primary unit memOTy>i€^esh secondary unit of the memory refresh section 6002R (FIG. 13). 

The^fbitrations I, II, and III produce Memory Output Enable signals MOEm, MOEh- 
i ( and MOEni-i, respectively, as indicated, for the watchdogs WDi, WDn and WDn, 

' 54 



respectively, as shown in FIG. 15. The arbitrations I, II, and III pro duce Mg moFY-Rgffesh 
Enable signals MREm, MREim, and MREum, resgectivgl)^^ for the watchdogs 

WDi, WDn and WDm, respectivel^s^hS^^ FIG. 15. The arbitrations I, II, and III 
produce Memory ft^nt^i^ials MGi, MGi, and MGm, respectively, as indicated, for the 
5 registei5^2€^r6204ii and 6204m, respectively, of filter 6202 2 of logic section 501 02, as 
^gow n i n F I G rfc&- 

Thus, it should be noted that while each one of the registers 7002 1. 7002 2 , 7002 3 , of 
filters 6002i, 6002 2 (FIGS. 19), are fed the same data from registers 7000i, 7000 2 , and 7000 3 , 
respectively, because of the time skew shown in FIG. 18, such registers 7002i. 7002 2 , 7002 3 , 
10 may not store the data which is in registers 7000 1, 7000 2 , and 7000 3 , respectively. However, 
the majority gates MG 7004i-7004 3 will produce the same data according to FIG. 17. 
Therefore, the three abitrations I, II, and III of arbitration logic 6004 2 will receive the same 
data (i.e., the data produced by the majority gates MG 7004i-7004 3 ) thereby providing 
coherency (i.e., synchronization) to the arbitrations I, II, and III even though the arbitrations 
1 5 are operating independently of each other. 

Other embodiments are within the spirit and scope of the appended claims. 
What is claimed is: 
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